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As a supplement to the principal reports, basic 
revision guidelines, philosophy, and procedures are discussed in this 
document relating to the U. S, Naval Academy Self -Paced Physics 
Course. Following a brief course description, analyses are made of 
the rationale for revision activities," study guide alteration, and 
content, objective, format, and remediation evolution. Revision 
decisions are made on the basis of empirical findings obtained during 
the Fall 1969 tryout in weekly posttests, final examinations, and 
students' study guide performances. The "confidence" scores, faculty 
and student item ratings, student preferences, fragmentary tijne logs, 
and options taken by students when assigned to the option condition 
are also referred to as additional information pertaining to the 
improvement of learning materials and processes. Included are a 
compilation of student academic performances, a detailed record of 
revision actions, comments of subject matter specialists on each 
revi:3ed problem, and major statistical results used in revision. 
(Related documents are SE 016 065 - SE 016 087 and ED 062 123 - ED 
062 125.) (CC) 
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A foreward to put the course in pers- 
pective. 
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A systems approach was applied to the development of a multimedia 
computer managed course in college physics for the U.S. Naval Academy. 
This is a brief description of that course. 

Goals 

Several purposes are served by the program's development and opera- 
tion. The Academy is provided with a cost-effective physics course de- 
signed with the most modern educational technology. The experience 
garnered in the construction of the program is incorporated into a course 
development model to serve as a prototype for construction of similar 
programs in other hard science courser,. Extensive record keeping capa- 
bilities of the program allow it to serve as a vehicle for educational 
research. 

Charao teristias 

The course is individualized, self-paced, and self-healing. By 
offering media options and optional routes through the learning materials 
each student's learning experience is individualized. Likewise, within 
broad time constraints, the student carl progress through these materials 
at his own pace. 

The self-healing aspect of the program pertains to learning mater- 
ials and processes. These are improved by an Iterative process of suc- 
cessive tryouts and revisions. In this way, the program undergoes an 
empirical optimization procedure. 
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Content 

Most standard topics in introductory classical physics are included 
in the two semester course: mechanics, wave phenomena, electricity, 
magnetism, and optics. One unusual feature is the omission of heat and 
thermodynamics in favor of more intensive developments in mechanics and 
optics to suit the Academy's particular needs. The subject matter is 
loosely defined as university physics with calculus at the level of 
Halliday and Resnick. 

Systems Approach 

Optimization of the program must be attained empirically, since no 
satisfactory predictive * ::y of educational psychology is known. This 
situation is well suited to a systems approach when the output of the 
system can be fed back to modify the system input. 

Behavioral Objectives 

This approach requires that the course objectives are clearly de- 
fined and measurable so that the output of the system is quantitative. 
Consequently, over a thousand measurable behavioral objectives (MBOs) 
were developed to completely specify the performance which the program 
should elicit. MBOs fall into two categories: terminal objectives (TOs) 
which describe the desired final student behavior, and the subordinate 
enabling objectives (EOs) which are steps toward the terminal behavior. 
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The TOs constitute a complete description of course content and 
are represented in the course by central cove problems. When a student 
can answer a core problem correctly, he is said to have achieved that 
TO. In this way a student knows exactly what is expected of him as to 
content and level of proficiency. 

When a student cannot answer a core problem after a single exposure, 
he can execute subordinate enabling problems which correspond to the E'Os. 
At the end of an enabling sequence, the student is presented with ano- 
ther version of the core problem to check his achievement of the TO. 
All these problems are contained in the Problem and Solution Book volumes, 

Media Components 

Videotape presentations are available for forty-nine topics. 
These tapes average about fifteen minutes apiece. Illustrated texts 
and talking books (taped voice-over illustrations in book form) are 
available with essentially the same information content as the video 
tapes. (Computer-assisted instruction (CAI) was initially included as 
a parallel path for topics in mechanics, primarily to be compared with 
the other options for cost effectiveness, and was deleted as a learning 
option in. the final revision.) Conventional physics texts are also 
included among the' available learning materials. 

Testing 

Each student is provided with a study guide which directs him 
through the problem books and various media assignments. When the stu- 
dent completes a specified assignment (roughly approximated by a 
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lapter in Halliday and Resnick) , he schedules a progress check (test) 
I the material. This criterion check does not influence his grade 
It is used for management and remediation purposes. Grades are deter- 
Lned by quarterly tests and final examinations for each semester. 

medials 

Minor remediation is accomplished by distributing a remedial sheet 
ssociated with each problem missed on the progress check. These sheets 
ave a statement of the appropriate core problem together with references 
3 pertinent auxiliary material. More serious remediation is providedi 
/ individual tutorial sessions with a professor, 

aboPatories 

The laboratories have as their objectives the measurement of funda- 
ental physical quantities, including the processing and recording of 
his data with an error analysis. An innovative aspect of the data 
nalysis is that a dialogue may be established between the student and 
he computer which would culminate in the student's achievement of the 
bjective. This computer-dialogue laboratory format is not an essent- 
ial element of the multi-media learning materials, and in the current 
mplementation the Navy Physics staff is using a conventional labora- 
ory experience for the self-paced course. 
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II THE REVISION PROCESS 



An overview of the revision effort 
including general revision guidelines, 
philosophy, and approach. 



The Revision Frooess 



Three basic sets of data present the results of the Physics S211 
multimedia course: the weekly posttest scores and item analyses; the 
final examination scores and item analyses; and the Study Guide problem 
scores, and breakdoOT. of choices selected. Additional information is 
provided by the "confidence'' scores, faculty and student item ratings, 
student preferences, the fragmentary time logs (these were kept by students 
only inconsistently, less accurately than was necessary, and were impossi- 
ble for faculty or project staff to control), and the options taken by 
the students when assigned to the Student Option condition. These sets of 
data provided the inputs for the initial revision decisions. As other 
analyses are performed (e.g., student characteristics, media materials , 
experimental treatments) , the results will be utilized in further revi- 
sion procedures. 

In simple terms, the purposes for which data are examined are the 
following: to determine how well the existing course materials facili- 
tated learning, and how reliably they did so; to determine which objec- - ' 
tives were major sources of difficulty; to determine where the instruc- 
tional materials were especially strong or weak; to determine how satis- 
factorily the basic course structure and design accomplished the "ideal" 
mission of teaching all objectives to all students. This is only the 
first step; a revision should be planned on information provided by the 
data, and not simply be a "now let's try something else", set of changes. 

It will be well to structure the description of the findings within 
a review of certain assumptions within which the tested version of the 
course was developed. The multimedia course was developed with an "open 
front end." This means that except for the descriptions of the course 
objectives that were given to the students at the beginning of each 
week's work, there was no guidance or control exercised over the students' 
learning activities; they began by studying assigned portions of con- 
ventional text materials. The students (except for certain of the experi- 
mental conditions) then worked through a set of relevant problems in the 
Study Guide, were branched to corrective information when an error was 
made, and then proceeded to the weekly posttest. Certain supplementary 
media materials were provided certain students as designated by the experi- 
mental design, but that phase need not concern us for the time being. In 
addition to the remedial branching provided by the Study Guides, a prelim- 
inary version of a computer management system was utilized to provide post- 
test results information to the physics faculty so that students could be 
assigned to instructor-conducted remedial sessions, individually or in 
small groups. In addition, students were able to consult with instructors 
at any time for what is referred to as "extra instruction" at the Naval 
Academy. It is apparent that the basic philosophy and design of the course 
emphasize remedial rather than shaping, or, in another context, a Pressey- 
type approach, rather than a-Skinner-type of methodology of instructional 
design. This approach represents a minimum kind of instructional pro- 
gramming and guided or controlled interaction, often assumed to be-^more 
appropriate and "all that is necessary" at the college and university 
level . 



EKLC 



-7- 



The results of the evaluation run-through indicate that the multi- 
media course, at this stage in its developmental testing, did about as 
well as the existing conventional course in terms of achievement. The 
positive side of this picture is the fact that the experimental course 
was a newly developed set of instructional events and materials and per- 
formed as well as the conventional course, a course that had been m 
operation at the Naval Academy for years, was very similar to other 
existing courses, and which had been revised and improved for many years 
by many faculty members. The experimental course, even under the vari- 
ous controls, schedules, and constraints of the testing requirements, the 
experimental design, data collection requirements, and the practical re- 
quirements of the Academy itself, produced results equivalent to those 
produced by the course with a much longer history of development. On the 
other side of the picture, however, the experimental multimedia course, 
S211 did not do any better than the existing course, and no time savings 
were'possible on an individual student schedule basis because it was not 
possible to operate a "free running course" within the constraints and 
requirements noted above. 

The "successive approximations" approach to course development, if 
appropriately applied, specifies that a "lean" approach be used. This 
means that successive drafts should undershoot the mark, progressively 
less with each revision. If students are given more guidance, direction, 
and too much of a small step approach, there is no convenient way to deter- 
mine where too much of anything was provided, or where less direction, 
less control, or less guidance might have been able to accomplish the 
instructional tasks. The lean approach specifies that less instructional 
involvement and less control be exercised .t'-an is assumed to oe needed, 
so that the empirical validation procedures can identify exactly where 
the deficiencies are, so that minimum necessary changes can be made. 
In other words, over-teaching generally cannot be identified if tae i_n. 
struction is successful, but under-teaching, when unsuccessful, can be 
precisely identified and the necessary revisions made. 

The lean approach was used for the developmf^nt of the tested version 
of the course being discussed in this report, at several levels, and for 
a number of components, activities, and materials. Specifically, the 
following components were lean, and for each a "less lean form is des 
cribed Where the evidence indicates that the present lean version did 
not accomplish its task, the less lean form will receive first considera- 
tion for the revision presently underway. 

1. Objectives: lean version is a simple descriptive state- 
ment for' the student, generally in the same form- developed and 
used by the course designers and faculty; next step would be 
• to simplify the objectives, and provide more detailed explana- 
tions at a level comprehensible to the students prior to any 
contact with the study materials. Lean approach assumes that 
the students will not understand the description completely 
when they first encounter it, but will develop comprehension 
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media, prior to the weekly post test. This variable involve- 
ment, and the unstructured nature of che interaction with the 
information in the conventional textbooks, is seen to be a 
major source of difficulty and ineffectiveness of the front 
portion of the course. This revisions should be made more 
self-standing by including "information panels" before the 
associated problems and by presenting graduated problems 
with detailed solutions for each objective, 

2. The students were given statements of the objectives 
at the beginning of each week of the course. These objec- 
tives were the same descriptions that were initially devel- 
oped by the course designers for communication with subject 
matter experts. Academy faculty, and other project staff. 
The objectives were not designed specifically to communi- 
cate the intent of the instruction to the student, T^en 
objectives' are frequently incomprehensible to the student 
until after he has achieved them, students tend to receive 
far less information from the objectives than is desirable. 
The purpose of giving a student the objectives is to pro- 
vide him with a concrete, identifiable goal, and to give 
him some basis for self-evaluation of progress toward that 
goal in terms of his o\m performance capability. If the 
objectives do not serv^^ that purpose, a major component of 
the system is missing; if the students recognize the defi- 
ciency, they tend to not bother to read the objectives, A 
major rewriting of objectives is called for to produce a set 
of written descriptions that will be comprehens ^^ble to the 
students prior to their contact with the study materials, 
and usable by the students as a progress evaluation guide. 

3, The Study Guides were drastically changed for the Fall 
1969 tryout, primarily because subject matter specialists 
Involved in the development of the revised Study Guides felt 
that a more complex level of problems and problem solving 
skill requirements was desirable than had been required in 
the previous version of the Guides; The remedial branches 
and the choices leading to them, were chosen on the basis 

of subject matter expertise and best judgments about the 
kinds of errors that would occur, rather than any empirical 
determination of actual errors that students might make in 
a free responding situation. The data indicate that the 
front end of the course, presum^.bly because of the charac- 
teristics of the objectives and textbook study described 
above, did not, in some cases, adequately prepare the stu- 
dent for the problems presented in the Study Guides, Nor, 
apparently, did the remedial material in the Study Guides 
adequately function as remedial instruction for students who 
most needed it, since students were missing questions on. the 
weekly posttests on the same objectives on which they had 
been remediated in the Study Guides, The level of complex- 
ity of the problems must be reviewed in the light of the 
Study Guide response data, the questions asked, and judg- 



the lean approach used for the objectives and textbook study 
was adequately followed through in this approach to the prob- 
lem exercises. A more programmed version of th^^ problem exer- 
cises could consist of several alternatives. Demonstration 
problems could be used to illustrate each principle "in action," 
and certain active response requirements could be inserted 
within the demonstration sequence* Students could be walked 
through a series of problems, increasing in difficulty and 
complexity, A sequence of hints could be provided, in increas- 
ing level of amount of information and direction included, so 
that a student could obtain assistance to the degree that he 
needed it. The remedial branching could consist of either of 
the preceding options, so that a student encountering difficulty 
in the major problem assigned could follow a track leading 
through further elaboration and assistance in solving simpler 
problems involving the same principle or approach to a solu- 
tion. A number of other options exist, but those just' des- 
cribed illustrate the kinds of approaches that might be util- 
ized to increase the amount of guidance, direction, and assist- 
ance available during the problem-solving exercises, 

4. Media components; here we are referring to those compon- 
ents that presented information on the same objectives in dif- 
ferent media forms (videotape, audio tape, instructor, etc) 
representing several of the treatments in the basic 7^ 7 experi- 
mental design. One major issue that was debated by the pro- 
ject staff regarding the nature and format of the media mater- 
ials Was the option of adding specific response requirements, so , 
that students would have to respond actively during or immed- 
iately following the media presentation. There is a possibility 
that if in fact there are differences in the amount and efficiency 
of learning among the various media presentations, active response 
requirements would wash out that difference. For several rea- 
sons, not the least of which was the pressure on the media pro- 
duction schedule, it was decided not to include response require- 
ments either during a presentation or immediately upon its com- 
pletion, A number of options exist for reducing the leanness of 
the media components; a topic outline 'and note-taking guide can 
be provided, or specific questions can be asked, with pauses added 
to the presentation for responding (or the student could, in the 
case of the equipment-presented media, be directed to stop the 
presentation), followed by a posttest which Could branch the stu- 
dent to remedial material or back to the presentation; without 
response requirements during the presentation, a practice exer- 
cise could precede the posttest, possibly with branching; and 
there are other possibilities. 

5. Remedial instruction following the Weekly posttests: the 
design specified individual or small group remedial instruction, 
based on an analysis of each student's posttest answers. The 
instructor was to attempt to diagnose the nature of each student's 




difficulty, and attempt to provide remedial instruction and, 
if desired, assign additional reir'^^l * ^ mnt«^rial. Ideally, 
every deficiency was to be rr^- ^ student proceeded 

on to the new material of t' Here again 

the remedial emphasis is ap in .lixcss the initial 

learning resulting from the ^ . activities that preceded 

a posttest was quite high and effective, the remedial burden 
on this element of the course would be considerable. By its 
nature, this form of remedial tends to be information presen- 
tation oriented, rather than an interactive tutorial, and 
without criterion questions for progress evaluation use, the 
burden on both the remedial instructor and the student might 
be more than could effectively be handled. The next possi- 
bility that might be considered is the development of a pro- 
grammed remedial module for each objective, or at least for 
every objective that the data indicate is a "trouble topic," 
accounting for major student difficulties and errors on the 
post tests, problems, and final examination. This pool of 
remedial materials, possibly supplemented by the instructors, 
poses certain developmental problems, and even more important, 
certain logical problems: if remedial instructional materials^, 
programmed or "conventional," effectively provide remedial 
instruction ("remedial" assumes? student failure has indenti- 
fied the need for the remedial instruction), they why shouldn't 
those materials be moved to the front end of the course to 
prevent the failure from occurring at all? The entire notion 
of remedial instruction, and its function, design, and place- 
ment, as well as its relation to other components of courses 
of instruction, deserves more attention in both philosophies 
and technologies of instruction. Some of the considerations 
will be relevant to the revision planning and decisions here, 

he weekly posttest data and the Study Guide performance data, when rela- 
ed to the instructional objectives upon which the problems and posttest 
tems were based, indicates clearly that the open front end of the course, 
upplemented by the remedial procedures, did not adequately result in 
tudents uniformly achieving the objectives. The Study Guide data fur- 
her indicate that the level and kinds of problems and related remedial^ \ 
id not adequately develop concept learning, concept utilization, and 
roblem-solving skills. Analysis of the problems from behavioral anal- 
sis and subject matter analysis points of view produced the following 
onclusions regarding the beginning portions of the course, including the 
extbook and Study Guide activities: 

!• Textbook study was apparently of variable effectiveness 
and efficiency, as indicated by the high error rates on the 
problems in the Study Guides and weekly posttests. Other 
information provided by students — including descriptive com- 
ments and study time information — suggests that textbook'study 
was largely exploratory, cursory, and many students simply 
scanned the material, planning to study the texts in greater 
detail after working through the Study Guide problems and- 
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as they achieve the objective and can, therefore, use the 
description as a progress evaluation criterion; when they 
understand the description, they have achievad the objective. 
The more detailed version assumes that additional assistance 
and information is needed to allow the desc 'ntive statement 
to help the student, by providing him with ^neaningful guide 
at the beginning to direct his study, his attending, and so 
that he can evaluate his progress throughouL, and not simply 
•discriminate terminal performance when he has achieved it. 

2. Textbook study: lean version assumes, first of all, that 
the lean version of the objectives will accomplish the task 
described above, and that, therefore, the student's reading 

of the text materials will include his own directed active 
responding, interpretation, application, and progress evalu- 
ation. The next step would be the addition of specific 
response requirements, directing the student's attention to 
critical information and clarifying it, and guiding the di- 
rect application, interpretation, and use of that information. 
Without replacing the existing text with a completely programmed 
text J the response specifications could be added in varying 
degrees through the use of an adjunctive program of one of 
many possible forms. 

3. Study Guides: the lean version chosen was one of many 
possible options. A more appropriate name for the present 
versions of the Study Guides would be "Problem Book," since 
the Study Guides do not actually guide the study of the stu- 
dents. Here again, the version used assumed that the objec- 
tives/textbook combination does its job, as described above. 
The problems presented require the application of the princi- 
ples that make up the iosbjectives, and it should be pointed out 
that a, common deflnlrlwn given by physicists of "knowledge of 
physics" is "the eslneaBtt to which the student can solve physics 
problems." Problems ^32£ trying degrees of difficulty were 
included in the Study-aii^ies , some involving straightforward 
application of a singferqadLnciple, some requiring analysis of 
conditions, discrimi iraviriTm of the principles involved, and 
one or more steps to Htr solution. The structure of the 
Study Guide included :diagi!iDS tic and remedial branching, al- 
though the Guides are ~not: branching programs in the usual 
sense, since they do not include explanatory material preced- 
ing a problem. It is. assumed that the student has studied the 
relevant explanatory material in the assigned textbooks. Again, 
following the lean appcroach, no attempt was made to teach prob- 
lem-solving skills in the Study Guides, assuming that the 
students would bring enough cognitive skills with them from 

the textbook study to solve each problem, or, if not, would 
have any deficiencies adequately remediated by the remedial 
branches in the Study Guides. One reason why the original 
project staff made the decision to choose this particular 
approach and Study Guide format was the assumed "high level 
of motivation" attributed to the Midshipmen. And, of course. 
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merits regarding the objectives, and the kinds of problem solving 
skills and activities required to work each problem. Some of 
these judgments have already proved to be quite straightforward, 
since in certain problems more was required than the objective 
specified, particularly in terms of the principle or principles 
involved, and often in cases in which the students had had no pre 
vious opportunity tv- rk on a problem related to that same objec 
tive, but in a cliu. loss ambiguous form. The students did 
not adequately .Mihiev? le course objectives from the objectives- 
textbook-Study Guidu uibination made available to them. The 
fact that the experimental students performed as well as the 
controls does not change that evaluation. The experimental 
course should, when administered in a free-running manner, per- 
mit the students to learn more effectively, primarily because 
of the extensive individualization of instruction. The prob- 
lem exercises need to be revised to provide more assistance, 
more guidance, and more opportunity to solve the problems cor- 
rectly, and more opportunity to respond correctly to the vari- 
ous steps in the problem-solving sequences. The initial re- 
view of the Study Guide response patterns was based on two sets 
of scores: a computer printout indicated the number of students 
selecting each of the alternatives for each multiple choice diag- 
nostic test item; the printout also indicated the number of 
students who chose only one answer (presumably the correct one 
on the f itst and only try) , the number who chose two answers 
(presumab^ one error follcHBEEd by the correct chcnnLce) , etc. 
The latter .indicates the arraamt of difficulty thse students 
encounteroiidLn solving each aipecific problem, and- the former 
indicates ntrire kinds of dif fircnl ties the students ^Encountered 
(assuming,,, ajf course, that ±asequest ions had nomvjor deficien- 
cies; foxzai discussion of rfer.ctest items, see ibselow) . One 
critical -:qi2EStions to be anssraeased is whether orrnD.t a student 
who does 'w^ZL (comparatively -speaking) on an objHc:tive on the 
related pnSlems in the Study Guide does any better on the 
weekly passsaest item for that objective than students who do 
less well-XBt that objective on the Study Guide problems. 

4. The teat: questions answered by the students as they pro- 
ceeded thrroish the course can be examined and must be examined 
individuaffifer in relation to each other and to the objectives 
they areuzi^^tgned to test from several points of view. The 
assumpt liim i vMi st be made that there is probably no such thing 
as a perSadr test item, valid in every way, perfectly reliable, 
testingrtfe^related objective at exactly the proper level of 
complexl'tj:, with minimum ambiguity, and whose structure and 
content is mncorrelated with intelligence or verbal ability. 
Having made ithis assumption, we must then view every test item 
with suspicion; if a student answers a question correctly, we 
consider tiaoe possibility that the item was too easy, or that 
the correctr answer was given away, or for some reason the stu- 
dent was-aMe to answer the^question correctly without having 
achieved tire: objective; if - a student answers a question incor- 



rectly, we consxder the possibilicy thai the item was too 
difficult, too ambiguous, the alternatives were inappropri- 
ately similar and without an adequate basis for discrimina- 
tion within the limits of the objective, or that for some 
reason students who have achieved the objective can still 
answer the test item incorrectly. Obviously this approach 
does not involve the rejection of every test item as either 
too easy or too difficult, nor is the percentage of students 
answering ■ ' n item correctly taken an a measure of difficulty, 
' is being made here is that test items are 
. above suspicion as being major determinants of the 
answers chosen or given, whether right or wrong, and inde- 
pendent of achievement or non-achievraent of the objective the 
item was designed to test. For example, if 90% of the stu- 
dents answer a question correctly, on a criterion referenced 
test, that result does not necessarily mean that the instruc- 
tion related to j±at objective is highly effective; it could 
mean that, but it could also tell us nothing at all about the 
instruction or about the number of students who achieved the 
objective— it might mean only that the test item was answerable 
on some basis other than having achieved the objective. Hav- 
ing more than on& test item for each objective does not neces- 
sarily solve the problem, although one jaight have more confi- 
dence in interpreting the results if fiw, or even tea or more 
test items on the saxBSt objectiire all yi°ld similar lerrels of 
performance. V- nfimmmuHi-^ ly, a preliminary ssaminatioa of test 
it€ans, arranged in: groaps testing the ss»me objective, indicates 
that wide variations -Hcxair; for example, one case, twelve 
jcofclems in one Study Baide were identifit s involving the 
aama, single objective., and several items . answered cor- 
ret3tiy by less than 30% of the students, x ale others were 
answered correctly by mnre than 60% of the students. There 
are many possible factors to consider in attempting to deter- 
mine what those dataimean, and what accounted for them. Which 
items give us the most valid information about the students 
and about the instruction and instructional materials? Here 
again, a critical examination of the items, the data., and the 
objectives must be performed by the project subject matter 
specialists and instnrctional :t3echnologi9ts . Certain judgments 
must be arrived .at, osen though a certattt amount of subjectivity 
Is involved, which uiill not be able to be defended in precise 
fiWhion by data. The irur pose of this tme of analysis is to 
attempt to decide whait the data mean, which test items provide 
the most relevant anfl meaningful information, and to make revi- 

decisions concerning both the test items and the instruc- 
^onal materials. It is unlikely that, a consistent bias would 
be present in favor of assuming that the instruction is better 
than it is in fact, since the entire purpose and opportunity at 
this point is to increase the course effectiveness and efficiency; 
any inappropriate judgment of acceptability and adequacy would be 
self-defeating because it would involve passing up an opportunity 
to improve the instruction at a point at which improvement would 
be called for by the alternative interpretation of the data. 
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5. Ifei remedial instruction provided on an individual basis 
folloraa^tthe identification of the items missed on each post- 
test X3ie. last element in the basic instructional ^sequence. 
Whateranr^se it may have accomplished, the assigned: ^remedial 
did ncctinmiik up the pieces and adequately remedy the; definien- 
cies .fsist^ achievement of the objectives. The review prob- 
lems iiritiiE: Study Guidje used for review' purposes at mid-semester 
and tfe^Ssial examination results indicate that majox^ gaps re-. 
mainei£^ nnmt only for occasional objectives, but across almost 
all al^Ert±ves. 

Iffieltean cut described earlier was apparently just about 
as lesnr/^Ttthe more conventional course upon which it was based. 
The Ssat-^ rpreliminary revision procedures have already been 
decid^^agmn, and their descriptions, along with the data inter- 
preta^featHsrcthat led to them, are described in detail below. 
Theseiidii^sic: decisions appear to be justified by the„inf ormation 
and dasLzasmlyses available to date, and are unlikeOby to be 
af f Pr-ig=^FTfar other inputs, such as the statistical ausiysis of 
the iiEE^.:3fesign, or more, fetailed examination of tfe data that 
have ^'-^^^^ij/ been reviewed:. 
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Ill STUDY GUIDE ALTERATIONS AND THEIR 
EMPIRICAL BASES 



A descripti^aEii of the various revisions* 
in f ormat ^paca and content and the find- 
ings which. JLed to these revisions. 
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STUDY GUIDE ALTERATIONS 
AND THEIR 
EMPIRICAL BASES 



Data and 2xperiea)rn£ from ti&jEall 1969 Multimsdia Physics Course 
indicateid that StiniEy GuidaHsr^mEeded revisions in fomiBl:, pace, and 
content. • 

Core Probfems 

At the mtstL fundamental Jfivel, it T^as clear tist the verbal state- 
ments of tEsrmiTial :q£i j e c±±a7es were not suf f iciEEttly precise. By 
comparing:l±he pasartests-:aiatd final, we found tkat different subject 
matter exerts, wrxiting ifenm the same statements of objectives, 
of ten prditoced pxo&ems xcf Tzery disparate leveiiS and complexity 
(see listed in PeiiEoxmaiiCHjna-tegories By Objecaive) . 

In order :tD redans ox: renEDve . this undesirable: isiasticity of the 
terminal aijecti333ra:, they-wre cast into proiaaem form- That is, 
explicit ^problems -whosesolirtions represent tJas. accoiig)lishment of 
the- behavioral dbSectxv^^ ais substituted for their ^Herbal "equiva- 
lents." With th^e oov^-r:pxt(A>lems as the modefe, couisffe content, 
level, and compleacity ai^:muach more preciselyrdef ined. This can be 
seen in part from the fart that core problems average two for every 
one verbal objectxve. I&i short, the core problems axe now taken as 
the definition of cour^ content. 

Time Allo.cated for Probfem So.lv±ng 

Perhaps the greatest single hinderance to cro^feria achievement in 
the Fall 1969 version was aiL insufficient allocation of time to 
work problems in the Study Guide. The aver^^e Study Guide time for 
all groups for all weeks is 199 minutes per week or 66 minutes per 
segment. This figure is remarkably small wheitL-one considers that 
even the subject matter experts and instructccEs find it takes an 
hour or more to read and solve twenty-four numerical problems and 
then review each printed solauition. And the physicists' performance 
on these problems is probab;!^ faultless and f^it. Compare this with 
the average student's perf oisaaace which is apparroxiiiiately 40% in ^ 
.'error, with each error leadTTug to a time-constrnfing lOBHtedial frame. 
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Moreover, we recall a widespread rule of thumb among physics 
instructors used to ascertain the average time a student will 
need for problem solving: "solve it yourself and mulitply your 
time by three." Even if a much more modest factor (say 3/2) 
were employed, we see that a majority of sttidonts spent 
insufficient time for the amount of matufial ai ...uid. It is 
likely that students in the conventional Academy course S211 
were handicapped in a like manner, since a course with con- 
siderably less content density per week has been instituted 
to replace S211, 

Alldiough the Fall 19'69 run may have been self-paced for some 
superior students, it is jclear that most midshipmen either had 
too little time avaClable, or became too fatigued or bored to 
devote sufficient irime to the Study Guide, In accordance with 
the "lean approach^" the::minimum. required rate has been revised 
by a modest factor- of 2/1, from three segments per week to two 
segments per week. Thus,, an expenditure of an equal amount of 
-.time should prodace a more complete accomplishment of the 
objectives • 

Extraneous Remediat±nn 

lin the original fonnad:, an effort was mad^ to include remedial^ 
instruction for each incorrect answer selection. The data indicate 
tiiat these time-consniiiiing specific remedial frames were not more 
effective than one general remedial frame for all dis tractors. 
¥e attribute this to the difficulty in 'anticipating just which 
errors are most prob^le in physics problems. 

Aiireasonable numerical measure of the efficacy of remediation is 
dbitained from the following ratio: 

number of double choices 

" total number of double, triple, and quadruple choices 

Wholly effective remediation is indicated when a is equal to its 
aiaxiDium value of unity. Completely ineffective remediation would 
be indicated by. a value of 1/3 which would result from a random 
selecti'on of one answer out of three, 

In tlBS special case of Volume N, the same general remedial frame 
^as speated for each of the three incorrect answer selections, 
Tke results for Volume N are compared with the course average in 
tire, ts^le below. The a ratios for specific remediation (course 
avers^e) and general, remediation (Volume are ,59 and -60, 
resp3m±iv!ely. We ^iie that, on the averag^e^ the specific remedia- 
tion fxaBBSS w^se r»dsa: mioare elective than one overall remedial frame. 
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imo 


three 

i 


four 




gCTieral 
(Vol ^) 


50- 6S 






8.4% 


a = .59 


3p6»r1f ic 
iferoEErse). 




24.4% 




6.5% 


o = .60 
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statements of Objectiv es 



Objectives were written for the student in a concise form which 
usually required some prior knowledge of the topic for the 
objective to be understood. Whenever the specific data indicates 
a weakness in concept or technique which is not primarily attribut- 
able to weakness in course materials^ ^he revision includes an 
Information Panel whic'i describes the objectives in behavioral 
terms which the stud eat can understand before he has studied the 
subject matter. 

Alterations 

All the f orementioned considerations guided changes in format for 
tiie revised Problem Books. These alteraiiions are detailed in the 
List of Revision Activities. Briefly stated, the most jsignificant 
changes are as follows: 

(i) The original unstructured linear sequence of Study 
Guide problems was reordered so that the core problems are 
encountered before the enabling problems are presented. This 
provides the student ^ith the clearest statement of the perform- 
ance which is required of him and provides an excellent advance 
organizer. If the student is able to solve the core problem, iie 
Is allowed to skip the enabling problem sequence^ This forward 
branching economizes the student's time and avoids his laboring 
unnecessarily over more praifelems. Another core problem., closely 
parallel to the original, is presented at tfe end of an enabling 
sequence. 

(il) Information panels precede the original core problems. 

(iii) Irrelevant remediation was removed^ but the detailed 
solutions to all problems are maintained. 

(iv) More flexibility for individualization was provided by 
separating the Study Guide into two parts, the Profelem Book and 
a Guide Book. This Guide Book comprises resiionsivs answer sheets 
which present the reading assignments, media assignments and 
optional selections. By making simple changes in tChese expendable 
sheets, various paths may be takeaa tiirough tSaie leacning materials. 



IV SPECIFIC REVISION ACTIVITIES 



A listing of the specxffcr-poDccedures 
and data used to implemesEt: tidV-islons 
in content, objectives^ iSarniat, and 
remediation • 



V 
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ADJUSTMENT OF CONTENT COVERAGE: OMISSIONS 



Activity Omit those terminal objectives which are of least 

importance, and which lie outside the scope of a 
conventional textbook. 



Data Base Professors* Rankings of TO^s 

TO assignments in Final Exam 

Subordinate TO assignments in 
Final Exam 

Director's Chart of Hierarchical 
Structure 

Contents of conventional texts 
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ADJUSTMENT OF CONTENT COVERAGE: OPTIONS 



Relegate to optional status those terminal objectives 
which are of lesser importance, ' which never occur as 
subordinate TO's in posttests or final exams, and 
which lie at the lowest level of the structural hier- 
archy of subject matter. 



Professors' Rankings of TO's 
TO assignments in Final Exam 
Subordinate TO assignments in Final Exam 
Director's Chart of Hierarchical Structure 
Student comments relating to topical interest 
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VALIDATION OF ITEMS 



Activity List each question and problem "as (1) valid, 

(2) invalid, or (3) grey area, on the basis 
of the data listed below. 



Data Base Posttest Scores 

Posttest Statistics 
Final Exam Scores 
Final Exam Statistics 
Study Guide Scores 
Study Guide Statistics 
Professors' Rating of Test Items 
Posttest Learning Categories 
Final Exam Learning Categories 
Study Guide Learning Categories 
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ADJUSTMENT OF CONTENT COVERAGE 



When the level of achievement designated essential 
for terminal objectives falls below 80% on any 
validated items, elevate the corresponding enabling 
objectives to the status of a terminal objective. 
Establish new, finer grained EO's to correspond to 
the new TO's. 

Professors' Ranking of TO's 

TO assignments in Final Exam 

Subordinate TO assignments in Final Exam 

Director's Chart of Hierarchical Structure 

Posttest Scores 

Posttest Statistics 

Final Exam Scores 

Final Exam Statistics 

List of Validated Materials 



WRITING FOR THE NEW TERl'IINAL OBJECTIVES 



Choose and create questions corresponding to 
the new enabling objectives. Write "Hint" 
pages when applicable, and write detailed 
solutions to the questions. 



The Briggs Program 
The AMP Course 

Phase I tests and homework problems 
USNA final examinations 
Phase II remedial material 



REVISIONS FOR INVALID AND GREY AREA ITEMS 



Each item is individually examined for misleading or ambiguous items, 
unfamiliar terms,' inappropriate coverage of objectives, and other peda- 
gogical faults. Each revision is separately documented. 
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STRUCTURAL ALTERATIONS I 



Motivation and 
Optimization of Time 



V::Llect and list questions and problems which, on a 
ne-to-one basis, most closely correspond to the 
ost comprehensive examination of the TO's. Use this 
_st as the backbone of a problem book, so that a 
:udent who can solve these problems need not work 
1 enabling objectives associated with and building 
>^ to the corresponding TO. This replaces the need 
ysT pretests. 



Professors' Rating of Test Items 
Pretests with TO assignments 
Posttests with TO assignments 
Final Exam with TO assignments 
Study Guide 
Time in Study Log 
Student Preference Data 
Extra Instruction Log 



STRUCZIIMAl ALTERATIONS II 

Remove Any Irrelevant 
^mediation 



Statistical evidence indicates rhat Uhe remedial frames 
did -not measurably improve stuciHnts'' ability to reach 
criterion.. This is attributed to difficulty in 
predicting just which errors are mosit probable in phy- 
sics problems. Include only those remedial frames 
which are demonstrated to be e£f ecad.-\^e. 



Number of answer selections in past Study Guides 



lUCTURAL AIZERATIONS III 



Flexii£I±ty for 
In d i v±i3iEEJ.i za t i o n 



Activity Cfe ate a Gui(^a Bq^Ic which is separate and d±^^inct 

"^s^ the prohiem- track. By s±mple page chsrn^ in 

Guide Book., t^htIidus pa^ths through the :-2srning 
-sasrrerials may be riTjaie. 

31^.3. Guide Be^iinil^TJes readi^ag assigraaen^^ Sr/ media 
.^^gnmexcts, isnd ocpriDn selections. 



ANCILLARY MATERIAL FOR REMEDIATION 

Activity Collect and create learning liStEriaJii^s Sor 

remedial study. 



Resources Semat and Blumenthal, "Collect ^^.v^ i^: A Programmed 

Aid," Vcl-inss 1-4 

Joseph and Leahy, "Programmed -r^jaU-^," Volumes 1-5 

Ashby and Miller, "Principles of ?!hhysics: A Pro- 
grammed Apinr;::^/^cih," Volumes 1-4 

The Briggs Program 
The AMP Course 
Remedials from Phase II 
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^Tm p-x- riEiCTIONS 



^txvity ExamioEE a=1' items for acceptable sryte :aTid language 



Data Base Style Sheer 
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WRITING TERMIl?^. GEBJECTIVES AT HnZQErr LEVEL 



Acti:zr±ty Rewrite e£r.!±: TO in a f one vbich. cart be understood 

by a studerrz hefove he prrrannters trhe associated 
learning ma^i^i^arial . 



Data IBasg Stoidies iui -rarbal learning; cmiceprt: of advance 

"oxganizejcs-/" 
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V PEH^OlHMilCE CATEGORIES BY OBJECTI^pS 



Sunmiary tables csS sttudErxt perforiuancos 
on posttests md fxmaX. «cains listed by 
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of 126 Tenmlnal Objectives, 60 wer-e evaluated by 
Final Exam test items: all were tested by weekly 
posttest itenas* Twenty vere closely related to 
^e "media preseaatation" . 

Of the 126 objectives, 11 wsara achieved fey 70% or 
more of !the students . indicated fay bothi posttest snd 
final '.exaia iDems: 29 were acMieved by 70% or mmre 
as indicated iyy posCtests onisr., no final exaEt itasm 
beJjig xelevanil to those objjectiwes : ancL 23 sslsjec- 
tives; were qxaestlonalble^ with irarore than UWZ on mne 
of the two indieatoES, anad fcelsw on t&ie oltiesr. This 
nneans that at best — rassnmniiiig "perfect" t3ESt: :Ltemis — 
53 (of ithe 126 objecttlves (exactly 50%) wiBifc utdnieved 
by 70% or Tnore of tiie stiiSents* 

Less than 70% of. the staiDfenifcs,. as indlcsited >jy botli 
postttest and f-riml exaim ifctsra, acEuieved 23 6 J the 
objBBctives, and' posttest scores for afejectivifeS ncit 
tested on .the final indicate tfiiat 38 other objectives 
were not adhieved. Thus a total of 63 objectives — - 
exactly half — failed to uneet: the arbitrary criterion 
of ^hievenaent by 70% or more of the sti^fients* 
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List A includes objectives on which less than 70% of 
the students were correct on posttest and final exam. 
List B includes objectives on which less than 70% were 
correct on posttest, for objectives not having been 
tested on the final exam. List C includes objectives 
tested on both posttest and final exam, and student 
scores less than 70% on either posttest or final exam. 

Lists D and E are objectives that were apparently 
learned relatively well. List D includes the objec- 
tives on which students scored above 70% on both post- 
test and final exam. List E lists objectives not 
tested on the firal exam, but with posttest scores 
above 70%» 
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I.IST A - both below 707= 



OBJECTIVE 


POSTTEST 


FINAL 


•8 2, 7 


19 


60 


10 


52 


57 


12 


31. 


47 


16 


3b 


60 


17 


0 


44 


18 


30 


58 


19 


25 


63 


21 


47 


27 


37 


51 


22 


41 


54 


65 


48 


15 


47 


68 


66 


54 


71 


38 


60 


73 


58 


51 


74 


51 


38 


82 


68 


27 


84 


68 


33 


88 


46 


45 


92 


69 


60 


100 


65 


43 


106 


57 


60 


108 


30 


46 


114 


40 


34 


115 


19 


32 


116 


44 


59 




7 
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LIST B NO FINALS POSTTEST BEUDW 70% 



OBJECTIVE POSTTEST 



1 


45 


2 


51 


3 


42 


5 


48 


9 


29 


23 


44 


26 


16 


29 


11 


32 


61 


33 


62 


42 


41 


44 


56 


46 


40 


47 


8 


57 


67 


58 


51 


59 


49 


61 


67 


63 


50 


79 


62 


95 


69 


97 


41 


98 


45 


101 


45 


102 


41 


103 


31 


105 


60 


109 


20 


112 


55 


113 


20 


118 


67 


119 


39 


120 


68 


121 


49 


122 


40 


124 


30 


125 


45 


126 


39 
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LIST C ONE ABOVE, ONE BELOW 70% 



OBJECTIVE 


POSTTEST 


FINAL 


A 
f 


55 


95 


g 
\j 


32 


71 


7 


56 


75 




53 


71 




96 


*38 




54 


72 


99 


89 


*36 


9S 


85 


*27 


21 

i 


58 


81 




77 


*35 




60 


76 


51 


83 


*65 


52 


95 


*57 


60 


66 


76 


62 


72 


*48 


72 


92 


*64 


75 


74 


*47 


89 


74 


*63 


91 


79 


*57 


93 


80 


*12 


107 


69 


71 


111 


82 


*65 


123 


73 


*52 



AV 
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LIST D 


BOTH ABOVE 70% 




11 


OBJECTIVE 


POSTTEST 


FINAL 


AV 


14 31 


94 


96 


X 


20 


88 


75 


X 


24 


76 


72 




30 


88 


77 




31 


94 


93 


X 


38 


75 


79 




40 


88 


82 


X 


49 


89 


78 




65 


75 


70 


X 


85 


90 


72 




86 


85 


89 




90 


76 


80 
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LIST E NO FINALS POSTTEST ABOVE 70% 



OBJECTIVE POSTTEST 



28 


89 


35 


71 


36 


83 


39 


88 


43 


76 


50 


96 


53 


77 


54 


90 


55 


92 


56 


79 


64 


100 


66 


98 


67 


80 


69 


79 


70 


80 


76 


73 


77 


75 


78 


ol 


80 


80 


81 


89 


83 


87 


87 


90 


94 


76 


96 


81 


99 


72 


104 


86 


110 


73 


117 


89 
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VI REVISION ACTIONS SUMMARY 



Detailed record of the actions taken 
to improve student performance for 
each terminal objective. (Includes 
old and new core problem correspond- 
ence.) 
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As :part of the final course revision, posttest performance data from 
every prx^blem was examined, as well as the items themselves, to recognize 
areas of student difficulty. On the basis of the performance data and 
thorough problem review remedial actions were performed. 

The full complement of remedial actions in the Study Guide consists 
of approfnclate information panels (IP) written for most terminal objectives; 
new core level problems (CL) which specify and /or exemplify the TO better 
than any^ essEisting problems where existing problems were inadequate to com- 
plete an. aaiabling loop; an expansion of the time devoted to an important 
objective*:: (TE) ; and in certain instances the expansion of material devoted 
to the objectives was critical (TEX); and after careful and thorough review 
some problems were omitted from the revised segments while others underwent 
some de^ee of problem revision (P.R. ). 

A guide to remedial actions has been compiled, arranged according to 
volume, and within each volume according to TO so that one may discover the 
new segment location of a particular TO and learn of all remedial actions 
pertinent to it. 

To use the summary, locate the terminal objective to be considered. 
The far right column refers to remedial actions pertinent to that TO. In- 
formation panels are labled according to the problem number they precede.. 
For example: IP 6 means information panel precedes problems number 6 in 
the segment. Where core level or enabling level problems have been added 
their location within the segment is included. For example: CL 5 means 
problem number 5 in the segment is a new problem of a core level. Prob- 
lem revision numbers refer to the number of the problem in the old version 
Study Guide, and, if the problem appeared in a segment whose number differs 
from the new segment in which it appears, the old segment number is given 
in parentheses. For instance: PR 5 (31) means that problem 5 from the old 
Study Guide 31 has been revised for use in the new Problem and Solution 
book in which it appears. 

All references to segments and problems pertain to the revised course 
with the exception of the problem revision (PR) numbers which must refer 
to the unrevised version. 
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ACTION LIST 



An InforTna:l~::s Panel, pertaining to this terminal objective, is now included, 
(number after IP means Q// which follows) 



Core Level Problem(s) - with solution(s) - has (have) been added. 



Enabling Lex^3Ea:blem(s?): ~Tcri.th solut±oii(s) has (have) been adaed. 



PR 

Problem Revi^^onL, amp 1 i f leal: ion s for -problems . 

(Refer te the Revised Problem Documentation for specific Revisions) 



TE 

Time Expansiooc, ':.i;Ctor judg^ed important. 

TEX 

Time ExpasESsion factor inaaged crucial. 
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KEY: IP = Inf armstrion psnel (number after IP = 
quest±inm numbier which follows) 



POSTTEST A CL = Core feT^l problem 

EL - Enabling level problem 

PR = Problem revision 

TE = TiiQfe^^agpansion 

TEX = Criirtlcal time expansion 



T.O. 


LIST 


SEG 




1 


B 


1 


IP 13 / CL 13, J3 / HL, i4, 15 / PR 1-8 / TE 


2 


B 


1 


Removed as a .seasrate saioectfere due to low 
prof, rating aiifi. JLack. gee islESTamce to other 
course objective.. 


3 


3 


1 


IP 1 / CL 1, 5 / PR rO, n / TE 


4 


C 


1 


IP 6 / IP 10 / CL 10, 12 / EL 8, 11 / PR 16, 20, 21 
IP* 1(2) / IP* 6(2) / CL* 6(2) / EL* 2(2) / PR* 17, 
22-24 / TE * Seg 2 


5 


B 


2 


IP 10 / PR 1, 2, 3, 4 / TE 


6 


C 


2 


IP* 1 / CL* 5 / PR 3^ 7 ■* Seg 3 


7 


C 


2 


IP 10 / IP 14 / CL 10, 13, 16 / PR 13 


8 


A 


2 


IP* 1 / CL* 5 / PR 12 / TEX * Seg 3 


9 


B 


2 


IP* 1 / IP* 12 / CL* 17 / PR 16, 18 * Seg 3 
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POSTTEST A 



(continued) 



LIST 



SEG 



ACTION 



10 



IP 17 / CL 21 ,/ EL 18 / TEX 



11 



IP 14 / CL 16 / PR 2L, 22., 23 



12 



-JF 12 / CL 17, 20 / '1S3L. This objectl-vE is 
also suppcETtasE rby dl2 -E&e preceding^. TOs . 
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KEY: 



IP — information panel (number after IP 
number which follows) 



= question 



CL = Core ievel problem 

EL = Enabling level prc^lem 

PR = Prab-lem revision 

TE = Time expansiom 

TEX = Critical time eaqransion 





Lrsar 


iSEOIENT 


ACTION 




c 


A 


IP 1 / CL 1, 32 / xEX PR 10, 11, lA, ly, , ^, 

13*(5), 17**(6) 

* Sag 3 Seg o 


15 


c 


A 


IP 6 / TEX 


L6 


A 


A 

5 


IP 16 ^ HL 20, 28 / TEX / PR 21, 22 
CL A 


17 ] 


A 


5 


IP 5 ,/ CL 9 / TEX / PR A, 8., lA, 19, 20, 21, 2A 


18- 


A 


5 
6 


IP 1 / CL A / TE 

IP 1, 2 / CL 7, 13 / PR 5, 6, 7, 10 


19; 


A 


6 


IP 1., 2, 9 / TEX / PR 12, 13, lA, 16, 18, 20, 21, 22, 
23, 24 




1 


1 
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POST TEST C 



KEY: 



IP = Infuarmation panel (number after 
numiEter which follows) 



= question 



CL = Core level problsn 

EL "= Enabling level piroblein 

PR = Problem revision 

TE = Time expansion 

•MX = Critical rime expansion 



T.O. 


LIST 1 


SEGMENT 


ACTION 


21 


A 


7 


TF 1, 5, 8, 11 / CL % 14 / TE / PR 9, 10 


22 


C 


7 


CL 14 / TEX , 


23 


B 


7 


IP 15, 18 / CL 17 / TE / PR 14, 16, 18, 19 


25 


C 


7 


IP 24 / CL 23, 29 / TE / PR 4*Ca), 18* (8) 
* Seg B 


26 


B 


8 


IP 9 / CL 12 / TE / PR 5, ^, 7, 8, 9 


27 


C 


8 


IP 5 / CL 8 / TE / PR 11, J-2, 15, 16 


29 


B 


9 


IP 6 / CL 10 / EL 8 / TE / I-R H, 12, 13, 14, 15 
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KEY: IP = infonnatian panel (number after 
0? - question mumbeT which follows) 



CL ~ Core level problem 
POSTTEST D EL Enabling L-evel problem 

PR = Problem revision 
TE = Time expansion 
TEX = Critical time expansion 



CO. 


LIST 


SEGIIENT 


.ACTION 


30 


D 


10 


IP 1, 5, 10 / CL 4^ 5, 9, 12 
PR 3 5 19 / Te 




n 

u 


10 


IP 13 / CL 15/ 

211 17 „ 20, 21 / TE 


32 


B 


m 


PR m„ 15, 16 / TE 






n 


IP 11/ m 13, 14 / TE 


33 


B 


10 


PR 23, 24 / TE 








IP 5 / OL 6, 9, 10 / m 


34 


C 


11 


IP 1 / t3L 4 / PR 4 / TE 


37 


A 


11 


IP 15, 1« / CL 17, 18, 22 / PR 24,- 17, 18, 16, 15/1 






12 


IP 1 / CL 9 / PR 4 / TEX 


38 


E 


12 


IP 10 / CL 13, 14 / EL 11, 12 
1 PR 6, 7,"8, 9, 21 / TE 



ERIC 



-48- 



KEY: IP = information panel (number after IP = 
question number which follows) 



CL - Core level problem 
POSTTEST E EL = Enabling level problem 

PR = Problem revision 
TE =s Time expansion 
TEX = Critical time expansion 



T.O. 


LIST 


SEGMENT 


ACTION 


41 


A 


13 


IP 1, 4 / CL 3, 9 / PR 7, 8, 9, 12, 16 (19) / TEX 


42 


B 


13 


IP 11 / CL 14 / PR 13, 19, 20, 21, 2(14) / TE 


^3 


E 


13 


PR 14 / TE 


46 


B 


13 


IP 19 / CL 18, 23 / 

PR 4(14), 6(14), 5(15), 15(15) / TE 


47 


B 


14 


IP 6 / CL 9 / PR 10, 11, 23, 24 / TE 


48 


A 


14 


IP 1, 14 / CL 5, 13 / PR 12-, 13, 14, 15, 16, 18, 
19, 21, 2(15), 3(15), 4(15), 8(15), 9(15), 16(15), 
17(15), 18(15), 19(15) / TEX 



-49- 



KEY: IP = Information panel (number after IP = 
question number which follows) 



CL = Core level problem 
POSTTEST F EL = Enabling level problem 

PR = Problem revision 
TE = Time expansion 
TEX = Critical time expansion 



T.O. 


LIST 1 


SEGMENT 
(NEW) 


ACTION 


49 


D 


19 


IP 1, 11, 15 / CL 11, 14, 19 / EL 12, 13, 17, 18 
PR 1(16), 2(16), 3(16), 4(16), 15(16), 16(16) / TE 


50 


E 


19 


PR 8(16) , 9(16) / TE 


51 


C 


19 


IP 6 / EL 8 / PR 20(16), 10(16) / TE 


52 


C 


23 


PR 12(16), 13(16), 14(16), 19(24), 22(34) / te 


53 


E 


20 


IP 9, 13, 18 / CL 13, 17, 18 / 

EL 14, 15 / PR 4(17), 6(17), 18(17) / TE 






21 


IP 1 / CL 4 / EL 2(17), 3(17) / TE 


55 


E 


20 


IP 5 / PR 8(17), 20(17), 21(17), 23(17) / TE 



ERIC 



-50- 



KEY: IP = Information panel (number after IP ^ 
question number which follows) 



CL - Core level problem 
POSTTEST G EL ^ Enabling level problem 

PR - Problem revision 
TE = Time expansion 
TEX - Critical time expansion 



SEGMENT 



T.O. 


LIST 


(NEW) 


ACTION 


56 


E 


22 


TE 


60 


C 


21 


IP 5 / CL 5 / TE 


61 


B 


21 


IP 10, 14 / CL 14 / 
PR 18(19) TE 


63 


B 


24 


IP 1 / PR 20(19) / TE 



KEY: IP = Information Panel (number after IP = 
question number which follows) 

CL =» Core level problem 

POSTTEST I EL « Enabling level problem 

PR « Problem revision 

TE « Time expansion 

TEX = Critical time expansion 

SEGMENT 



T.O. 


LIST 


(NEW NO;) 


ACTION 


64 


E 


22 


IP 5 / TE 


65 


D 


22 


IP 9 / CL 13 / TE 


67 


E 


23 


IP 9 / /PR 9(24) , 12(24) , 5(25) / TE 


68 


a' 


23 


IP 21 / CL 25 / PR 21(25), 23(24) / TEX 


69 


E 


23 


IP 1, 5 / CL 4, 5, 8 / PR 18(25), 18(24), 19(24), 
20 (24), 16(25) / TE 


70 


E 


23 


IP 17 / CL 20 / PR 9(25), 10(25) / TE 



ERIC 



-52- 



J^^t IP = Information panel (number after IP = 
question number v;hich follows) 



CL « Core level problem 
P OSTTEST J EL « Enabling level problem 

PR * Problem revision 
TE « Time expansion 
TEX = Critical time expansion 



SEQENT 



T.O. 


LIST 


(NEW NO.) 


ACTION 


71 


A 


24 


IP 5 / CL 6, 10 / TEX 


72 


c 


24 


IP 11 / TE 


73 


A 


24 


TP 15 / PR 1 (IT) 1 TEX 


75 


C 


25 


IP 1 / CL 5 / EL 4 / 23(26) / TE 


76 


E 


25 


IP 14 / CL 13, 14, 18 / EL 17 / TE 


78 


E 


26 


IP 1 / TE 


79 


B 


25 


IP 6 / EL 7 / PR 22(27, 18(27) / TE 


26 


IP 6 / EL 8 / PR 20(27) / TE 



-53- 



KEY: IP = 



Information panel (number after IP = 
question number which follows) 



Core level problem 
Enabling level problem 
Problem revision 
Time expansion 
Critical time expansion 



T.O. 


LIST 


SEGMENT 


ACTION 


81 


E 


27 


IP 1, 6 / CL 1, 5, 6, 9 / EL 30, 32 / PR 9C28) / TE 


82 




26 


IP 10, 15 / CL 14 / EL 13 / PR 14C28), 15(28) / TE 


83 


E 


27 


IP 10 / CL 10, 16, 18 / PR 19(28) / TE 


84 


A 


28 


IP 1, 6 / TEX 


85 


D 


28 


IP 10 / CL 14 / PR 24(29) / TE 


86 


D 


28 


IP 15 / CL 19 / TE . 



t 



CL = 

POSTTEST K . 

PR = 
TE = 
TEX 



ERIC 



-54- 



KEY: IP - Information panel (number after I? = 
question number which follov:s) 



CL = Core level problem 

POSTTEST EL = Enabling level problem 

PR = Problem revision 

TE = Time expansion 

TEX = Critical time expansion 



SEGMENT 



T.O. 


LIST 


(NEW NO.) 


ACTION 


87 


E 


29 


IP 9 / TE 


88 


A 


29 


IP 1 / TEX 


89 


C 


29 


IP 5 / CL 8 / TE 


90 


D 


29 


IP 15, 21 / CL 21, 24 / PR 21(30), 16(30)/ TE 


91 


C 


30 


IP 1, 5, 10 / CL 5, 9, 16 / EL 8 / TE 


93 


C 


30 


IP 19 / CL 23, 26 / EL 25 / PR 24(31), 19(32) / TE 


94 


E 


31 


IP 1 / TE 


95 


B 


31 


IP 7, 11 / CL 10, 14 / EL 13 / TE 


96 


E 


31 


IP 15 / PR 15(32) / TE 



KEY: IP = Information panel (nunber after IP = 
question which follows) 

CL = Core level problem 

POSTTEST H EL = Enabling level problem 

PR = Problem revision 

TE = Time expansion 

TEX = Critical time expansion 



T.O. 


LIST 


SEGMENT 


AC 1 lUN 


99 


E 


34 


IP 9 / PR 3(33) / TE 


100 


A 


34 


IP 1, 16 / CL 16 / PR 5(33), 23(34) / TEX 


101 


B 


34 


. IP 13 / PR 6(35) / TE 


102 


B 


33 


IP 1 / CL 4, 8 / PR 11(33) / TE 






35 


PR 13(36) / TE 


103 


B 


33 


IP 9 / CL 9, 13 / EL 10, 11 / PR 16, 19 / TE 


105 


B 


33 


IP 14 / CL 14 / EL 15, 16 / TE 






- 34 


IP 1, 5 / CL 8 / EL 6, 7 / PR 24(33) / TE 


106 


A 


32 


IP 9 

PR 15(34), 23(24), 2(34), 9(34), 10(35) / TEX 



ERIC 



-56- 



KEY: 



IP = Informatiou Panel (number after IP = 
question number which follows) 



CL = Core level problem 
POSTTEST N EL = Enabling level problem 

PR = Problem revision 
TE = Time expansion 
TEX = Critical time expansion 



T.O. 


LIST 


SEGMENT 
(New No . ) 


ACTION 


107 


C 


35 


IP 1 / CL 1, 5 / TE 


108 


A 


35 


IP 6 / /PR 6(36, 18(36) / TEX 


110 


E 


35 


IP 10 / TE 


112 


B 


36 


IP 1 / CL 5 / EL 2,3/ 
PR 2(37) / TE 


113 


B 


36 i 


IP 6 / CL 15, 16 / EL 11 
PR 5(37) / TE 


114 


A 


37 


IP 1, 6 / TEX 


38 


IP 1 / CL / TEX 


115 


A 


37 


IP 10 / TEX 


116 


A 


37 


IP 14 / CL 14 / TEX 



ERIC 



-57- 



KEY: IP = 



Information Panel (number after IP = 
question number which follows) 



CL - Core level problem 

POSTTEST 0 EL - Enabling level problem 

PR = Problem revision 

TE = Time expansion 

TEX = Critical time expansion 



SEGMENT 



T.O. 


LIST 


(NEW NO.) 


ACTION 


118 


B 


38 


IP 6 

PR 12(39) / TE 


119 


B 


38 


IP 11 / TE 


120 


B 


38 


IP 18, 22 / CL 18, 26 / PR 20(39) / TE 


121 


B 


39 


IP 1, 15 / PR 3(40), 14(40) / TE 


122 


B 


39 


IP 7 

PR 13(40) / TE 


123 


C 


39 


IP 10 / TE 


124 


B 


40 


IP 7, 15 / TE 


126 


B 


40 


IP 1, 11 / CL 11, 14 / TE 



ERIC 



-58- 



VOL A SEG 1, 2, 3 



SEG 1 



CORE 


POSTTEST 
QUESTIONS 


TO 


NEW NO 


OLD NO 


1 


New 






6 


16 


A 2, H 1 


• 4 


10 


New 






13 


New 







-59- 



VOL A SEG 1. 2. 3 
SEG 2 



CORE 


POSTTEST 
QUESTIONS 


TO 


NEW NO 


OLD NO 


1 


15(1) 


A 10 


9 


6 


New 






10 


New 






14 


22 


A 6 


11 


17 


New 







ERIC 



-60- 



VOL A SEG 1, 2, 3 



SEG 3 



CORE 


POSTTEST 
QUESTIONS 


TO 


NEW NO 


OLD NO 


1 






20 


A 9, H 2 


6 


6 






13 


A 10 


9 


12 






11 


A 9, H 2 


6 


18 






4 


A 10 


9 



I. 

i 

i' 



ERIC 



-61- 



VOL B SEG 4. 5, 6 



SEG 4 





CORE 


POSTTEST 
QUESTIONS 


TO 


NEW NO 


OLD NO 


1(4) 


23 


B 1 


1 'I 


2(4) 


2 


t) ^ 
B J 


1 1 






S 1 


13 


6 




B 2 


14, 15 


11 


12 


B 3 


15 


16 


Zl 




lo 


21 


14 


1 




26 


19 






29 


10 






32 


26 















ERIC 



-62- 



VOL B SEG 4, 5, 6 



SEG 5 



CORE 


POSTTEST 
QUESTIONS 


TO 


NEl^ NO 


OLD NO 


1(5) 


1 


B 6 


17, 14 1 


2 


3 


B 6 


17, 14 


5 


8 






10 


9 






11 


20 






12 


21 






13 


10 . 






18 


11 















ERIC 



-63- 



VOL B SEG A, 5, 6 



SEG 6 



CORE 


POSTTEST 
QUESTIONS 


TO 


NEW NO 


OLD NO 


1(6) 


9 






2 


8 


B 7 


18 


8 


11 






9 


15 






14 


21 


B 4 


19 


15 


20 






16 


23 















-64- 



VOL C SEG 7, 8, 9 



SEG 7 



CORE 


POSTEST 
QUESTIONS 


TO 


NEW NO 


OLD NO 


1(7) 


6 






2 


3 


C 1 


20 


5 


9 


C 2 


21 


10 


24 






15 


18 


C 4 


23 


18 


16 


C 4 


23 


24 


21 






27 


22 






t 









ERIC 



-65- 



VOL C SEG 7. 8, 9 



SEG 8 



CORE 



NEW NO OLD NO 



POSTTEST 
QUESTIONS 



TO 



1(8) 

5 

9 

13 
18 



2 

11 
7 

17 
22 



C 5 

C 6 / C 8 
C 7 



24, 25 

25, 27/27 
26 



ERIC 



■66- 



VOL C SEG 7. 8, 9 



SEG 9 



CORE 


POSTTEST 
QUESTIONS 


TO 


NEW NO 


OLD NO 


1(9) 


4 


C 9 


28 


4 


8 


C 9 


28 


6 


14 


C 10 


29 











ERIC 



-67- 



VOL D SEG 10. 11. 12 
SEG 10 



CORE 


POSTTEST 
QUESTIONS 


TO 


NEW NO 


OLD NO 


1(10) 






19 


D 1, H 10 


30 


5 






naw 






10 






5 


D 1, H 10 


30 


13 






18 


D 2 


31 


16 






■ 12 


D 3 


32 


19 






22 


D 4, H 11 


33 



68- 



ERIC 



VOL D SEG 10, 11, 12 



SEG 11 



CORE 


POSTTEST 
QUESTIONS 


TO 


NEW NO 




OLD NO 


1(11) 


/■ 


1 


D 5 


34: 


5 




12(12) 


D 4, H 11 ■ 


33 


11 




17(12) 


D 3 


22 


15 




; 24 


D 8, H 12 


37 


18 




' 25 new 







ERIC 



-69- 



VOL D SEG 10, 11.. 12 



SEG 12 



CORE 


POSTTEST 
QUESTIONS 


TO 


NEW NO 


OLD NO 


1(12) 






21 (11) 


D 8, H 12 


37 


6 






18 


D 8, H 12 


37 


10 






6 


D 9 


38 


14 






5 


D 9 


38 



ERIC 



-70- 



VOL E SEG 13, 14, 15 



SEG 13 • 



CORE 


POSTTEST 
QUESTIONS 


TO 


NEW NO 


OLD NO 


1(13) 


10 


E 3, H 13 


41 


4 


7 


E 3, H 13 


41 


10 


14 


E 5 


43 


11 


19 


E 4 


42 


15 


5(15) 


E 8 


46 


19 


8(14) 


E 8 


46 



ERIC 



-71- 



VOL E SEG 13, 14, 15 



SEG 14 



CORE 


POSTTEST 
QUESTIONS 


TO 


NEW NO 


OLD NO 


1(14) 


7(15) 


E 10, H 15 


48 ■ 


6 


6(15) 


E 9 


47 


10 


19(15) 


E 10, H 15 


48 


14 


20(14) 


E 10, H 15 


48 



-72- 



ERIC 



VOL G SEG 18, 19 



cvr. 1 o 



CORE 


POSTTEST 




NEW NO 


OLD NO 


QUESTIONS 


TO 


1(19) 






/ 

1(16) 


F 1, H 16 


49 


2 






2(16) 


F 1, H 16 


49 


5 






7(16) 


F 3 


50 


6 






21(16) 


F 7, F 9 


54 


11 






New 






15 






15(16) 


F 1, H 16 


49 



ERIC 



-73- 



VOL H SEG 20. 21. 22 



SE G 20 



CORE 


POSTTEST 




NEV/ NO 


OLD NO 


QUESTIONS 


TO 


1(20) 






New 






5 






7(14) 


F 8 


55 


9 






4(17) 


F 6, F 10, 
H 18 


53 


13 






New 






18 






New 







ERIC 



-74- 



VOL I SEG 20, 21, 22 



SEG 21 



CORE 


POSTTEST 




NEW NO 


OLD NO 


QUESTIONS 


TO 


1(21) 


14(14) 


F 6, F 10, 
H 18 


53 


5 


New 






10 


5(19) 


G 7, H 20 


62 


14 


New 







ERIC 



-75- 



VOL H SEG 20, 21. 22 
SEG 22 



CORE 


POSTTEST 




NEW NO 


OLD NO 


QUESTIONS 


TO 


1(22) 


1(18) 


G 1 


56 


4 


New 






5 


2(23) 


I 1 


64 


9 


8(23) 


I 2, I 19 


65 


14 


14(23) 


12, I 10 


65 



ERIC 



-76- 



VOL I SEG 23. 24. 25 



SEG 23 



CORE 






NEW NO 


OLD NO 


QUESTIONS 


TO 


1(23) 




18(25) 


I 7 


69 


5 




New 






9 




3(24) 


I 4, 15, I 9 


67 


17 




14(25) 


I 8 


70 


21 




7(25) 


I 6 


68 


22 




19(25) 


I 4, I 5, I 9 


67 


23 




21(25) 


I 6 


68 


24 
25 




13(25) 
New 


F 2, F 5, 
H 17 


52 



ERIC 



-77- 



VOL I SEG 23, 24, 25 



SEG 24 



NEW NO 



CORE 



OLD NO 



POSTTEST 



QUESTIONS 



TO 



1(24) 

6 
11 
15 



6(19) 
New 
6(26) 
8(27) 



G 8 

J 2 
J 3 



63 

72 
73 



ERIC 



-78- 



VOL I SEG 23. 24. 25 



SEG 25 



CORE 


POSTTEST 
QUESTIONS 


TO 


NEW NO 


OLD NO 


1(25) 




22(26) 


J 5 


75 


6 




19(27) 


J 9 


79 


10 




20(26) 


J 5 


75 


14 




New 







ERIC 



-79- 



VOL J SEG 26. 27 



SEG 26 



NEW NO 



CORE 



OLD NO 



POSTTEST 



QUESTIONS 



TO 



1(26) 
6 
10 

15 



15(27) 
24(27) 
12(28) 

13(28) 



J 8 
J 9 

K'lTk 10, 
*K 6, *K 9 

K 1, K 10, 
*K 6, *K 9 



78 
79 
82 

82 



-80- 



V OL J SEG 26, 27 . 
SEG 27 



CORE 


POSTTEST 
QUESTIONS 


TO 


NEW NO 


OLD NO 


1(27) 






New 






6 






New 






10 






New 






16 






New 







ERIC 



-81- 



VOL X SEG 28. 29 



SEG 28 



CORE 


POSTTEST 




NEW NO 


OLD NO 


QUESTIONS 


TO 


1(28) 




5(29) 


K 9, *K 2 


84 


6 




11(29) 


K 9, *K 2 


84 


10 




15(29) 


K 9, *K 2 


84 


15 




19(29) 


K 4, K 5, 
*K 7, *K 10 


86 



ERIC 



-82- 



VOL K SEC 28, 29 



SEG 29 



CORE 


POSTTEST 
QUESTIONS 


TO 


NEW NO 


OLD NO 


1(29) 


9(30) 


L 2, *L 1 


88 


5 


13(30) 


L 3, *L 9 


89 


9 


3(30) 


L 1, *L 10 


87 


15 


22(30); 


L 3, *L 9 


89 


21 


New 







ERIC 



-83- 



VOL L SEG 30. 31. 32 



SEG 30 



CORE 


. POSTTEST 
QUESTIONS 


TO 


NEW NO 


OLD NO 


1(30) 




3(31) 


L 5. *L 8 


91 


5 




New 






10 




12(31) 


L 5, *L 8 


91 


16 




New 






19 




21(31) 


L 7 


93 


2-? 




New 







-84- 

O 

ERIC 



VOL L SEG 30, 31, 32 



CORE 


POSTTEST 
QUESTIONS 


TO 


NEW NO 


OLD NO 


1(31) 




9(32) 


L 8, *L 4 


94 


7 




8(32) 


L 9, *L 6 


95 i 


11 




11(32) 


L 9, *L 6 


95 


15 . 




14(32) 


L 10, *L 5 


96 



ERIC 



-85- 



VOL L SEG 30, 31, 32 



SEG 32 



CORE 


POSTTEST 
QUESTIONS 


TO 


NEW NO 


OLD NO 


1(32) 


5(33) 


M 4 


100 


4 


5(34) 


M 10 


106 


9 


19(34) 


M 10 


106 


16 


New 







ERIC 



-86- 



VOL M SEG 33, 34, 35 



SEG 33 



CORE 


POSTTEST 
QUESTIONS 


TO 


NEW NO 


OLD NO 


1(33) 






11 


M 6 

• 


102 


5 






14 


M 6 


102 


9 






New 






14 






New 







ERIC 



-87- 



VOL M SEG 33, 34, 35 



SEG 3.' 



CORE 


POSTTEST 
QUESTIONS 


TO 


NEW NO 


OLD NO 


1(34) 






24(33) 


M 7 


105 


5 






21(33) 


M 7 


105 


9 






9(35) 


M 10 


106 


13 






6(35) 


M 4 


100 



ERIC 



-88- 



VOL M SEG 33. 34, 35 



SEG 35 



CORE 


POSTTEST 
QUESTIONS 


TO 


NEW NO 


OLD NO 


1(35) 






New 






6 






7(38) 


N 3 


109 


10 






23(36) 


N 4 


110 


15 






13(36) 


M 6 


102 



ERIC 



-89- 



VOL N SEG 36, 37, 38 



SEG 36 



CORE 


QUESTIONS 


TO 


"new no 


OLD NO 


1(36) 


2(37) ■ 


N 6 


112 




5(37) 


N 7 


113 


10 


18(38) 




157 


15 


New 






16 


New 







ERIC 



-90- 



VOL N SEG 36, 37, 38 



SEG 37 



CORE 


POSTTEST 
QUESTIONS 


TO 


NEW NO 


OLD NO 


1(37) 






9(37) 


N 8 


114 


6 






18 


N 8 


114 


10 








N 9 


115 


14 






New 







ERIC 



-91- 



VOL N SEG 36, 37, 38 



SEG 38 



CORE 


POSTTEST 
QUESTIONS 


TO 


NO 


OLD NO 


1(38) 






New 






6 






12 (39) 




158 


11 






15(39) 


0 3 


119 


18 






New 






22 






23(39) 


0 4 


120 



ERIC 



-92- 



VOL 0 SEG 39, 40. 41 



SEG 39 



CORE 


POSTTEST 
QUESTIONS 


TO 


NEW NO 


OLD NO 


1(39) 






21(40) 


0 5 


121 


7 






10(40) 


0 6 


122 


10 






19(40) 


0 7 


123 


15 






14(40) 


0 5 


121 




ERIC 



-93- 



VOL 0 SEG 39, 40, 41 



SEG 40 



CORE 


POSTTEST 
QUESTIONS 


TO 


NEW NO 


OLD NO 


1(40) 


17(41) 


0 10 


126 


7 


20(41) 


0 8 


124 


11 


New 






15 


21(41) 


0 8 


124 



ERIC 



-94- 



PROBLEM CORRESPONDENCE 



NEW OLD 
SEG // PROB SEG // PROB // 



1 


1 

X 








J. 


z 














X 


XI' 


± 


A 




X 


x^ 


L 




(nsw) 






i 


/: 
O 




i 


Id 


J. 


7 




X 


X7 


1 


Q 

O 


(new) 






1 


Q 


(new) 






1 


iU 


Qnew; , 






1 


XX 


(new) 






L 


IZ 


(new) 








X J 


(new) 






X 


1 /• 
I'* 


(new) 






1 


15 


(new) 






i 


16 


(new) 






2 


1 
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33 


12 


33 


16 


33 


13 (new) 






33 


14 (new) 






33 


15 (new) 






33 


16 (new) 






33 


17 


33 


19 


34 


1 


33 


24 


34 


2 


33 


20 


34 


3 


33 


22 


34 


4 


33 


23 


34 


s: 


33 


21 


34 


0 : (new) 






34- 


7 '(new) 






34 


8 . (new) 






34 


9 


35 


9 


34 


10 


33 


1 


34 


\ 11 


33 


2 
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FROBLEM CORRESPONDENCE 
(continued) 



NEW OLD 



SEG // 


PROB // 


SEG // 


PROB # 


34 


12 


33 


3 


34 


13 


35 


6 


34 


14 


35 


L 


34 


15 


35 


2Z 


34 


16 


35 


3 


34 


17 


35 


4 


34 


18 


35 


5- 


34 


19 


35 


7 
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^11 REVISED PROBLEM DOCUMENTATION 



Comments of subject matter experts 
pertaining to each revised problem. 



ERIC 
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Segment 1 #1-8 



These items lack relevance to the understanding of physics and have 
been omitted. 



T.O. 1 



c„„„^„^ 1 #in Rl R2 R3 R4 

Segment 1 #10 25 7 



A valid item which has been retained in the study guide. Performance 
data is attributed primarily to other factors as indicated. 

T.O. 3 



^ - m R2 R3 R4 

Segment 1 #11 ^ g 



Although the item and its pertinent d. a are valid, it has been 
omitted since other questions better suppor.. the T.O. 

T.O. 3 



g ?7 II 



A valid questiximiihlch has been retained in the study guide. 

1,0. 4 
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SegDEDt 1 #17 



Rl 
52 



R2 R3 
48 20 



R4 
9 



valid item which remains in the study guide.. 



^ „ ii,n Rl R2 R3 R4 



.Although this item is valid other questions support the T.O. and 
arEi^a^Erred . 



&~«tZl#n ^1 R3 R4 

^™ '^-•^ €7 24 13 10 



aas^EiViSia^ this xtem is valid other (jnestions: aippcart the T.O. and 



SesM: 1 #22 • Rl R2 R3 R4 

46 35 22 11 



IBitfc UBirttiirmodification- of- the correct ' answex this item has been 
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Segment 1 #23 



Rl R2 R3 
38 22 25 



R4 
27 



A valid item, however its contents are best handled in the 
information panel. 

T.O. 4 



Segment 1 #24 Rl, R2 R3 R4 

77 26 IQ 3 

This item has been rejected since it requires an ability nar-xelewant 
to this level course. 

T.O. 4 



Segmenfe- 2 //I • . Rl R2 R3 R3 

99 30 4 0 

This item has been eliminated -^-wn the study guide since its content 
is not relevant to the course objeczirsaBB . 

T.O. 5 



Segment 2 #2 Rl R2 R3 R4 

102. 26 4 0 

This item has been omitted' firr content deficiencies. 
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Segment 2 03 



Rl R2 R3 RA 
122 9 1 0 



ERIC 



Item has been rejected for content not pertinent to course 
objectives. 

T.O. 5 



Segment 2 #4 ^ ^2 R3 R4 

^ 1Q9 18 3 0 



OthengEBestions^-Tmore pertinent tc ithe T-C. have received preference 
over this itEEi. 

T.0_:5 



Segn^t 2 #5 R3 R4 

105 22 5 1 



This :aiHit: has -been omitted due toj omtent Irrelevant to course 
objectives, 

T.O. r6 



Segmmt 2 #7 R3 R4 

53 76 3 0 



An acceptable question which has baeen used in the new version 
study guide. 

T.O. 6 
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Segment 2 #12 



Rl R2 R3 R4 
57 50 14 8 



A valid item, however the question does not adequately test the T.O. 

T.O. 8 



Segment 2 #13 ^ 



With a slight moad if i cation of graph (1) for clarification this 
pmblem will be used again. 

T^O. 7 



Segment 2 #16 Rl R2 R3 Rf 

^ 51 55 17 4 



A valid question which will reappear in the study guide. 

T.O- 9 



c«™a«-i- 9 *iR Rl R2 - R3 R4 

Se^eat 2 #18 



Am appropriate qnestiou to test the r.O. Performance data is attribu- 
ted \pxiaEErily to other factors as ±ndicated. 

T.O. 9 
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Segment 2 #21 



Rl R2 R3 

51 36 23 



Being merely an exercise in calculus this item will not reappear in 
the new study guide. 

T.O. 11 



0 ysoo • Rl R2 R3 R4 

Segment 2 #22 ^3 



A highly modified version of this question with appropriate changes 
the solution will be used as a core question in the new version. 

T.O. 11 



c ^ o Ao-i Rl R2 R3 R4 

Segment 2 #23 ^3 ^2 



A valid item which will appear in the. enrichment segment of the new 
version study guide. 

T.O. 11 
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Segment 4 *4 



Rl R2 R3 R4 
43 78 8 0 



This item is valid. Its solution may be enhanced by changing the 
sentence which reads; "A force of 85 lb. . ., " to now read: "A force 
<the weight) of 85 lb acts downward." Further, since the mathematical 
solution is quite: clear and succinct it too should he included i.e., 

2:Fy = 0 
/ +- <-w) = 0 

TO 13 



Segment 4 #10 KIl R2 R3 R4 

3X 39 23 30 



This item is fully acceptable as it reads. HtssEwer, commuting it 
with item eleven (I'l) will place both in a more sp rt pM ^ e sequence. 

TO 13 



Segment 4 #11 ^ R2 R3 R4 

. 65 50 12 2 



See remarks for item #10 of Segment 4. 

TO 13 



Segment 4 #13 BX R2 R3 R4 

53 26 34 15 



The statement of the problem and its alternate anssser: are accept- 
able. 

It would he helpful to the student if he -couM see the vertical 
component of the external force F, in the s olvEtiomi^iagraiE. Also, 
usage of the letter "N" for both the normal force andi the. direction 
vertically up is ambiguous . 

TO 14 
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segment 4 #14 Rl R2 R3 R4 

54 47 21 6 



The problem is valid and well described. 

Two trivial changes to "clean-up" the solution may be made. That 
is, replace 8 with its equivalent of 30°; and eliminate the words 
. .makes life easier and. . 

TO 13 ^ 



Segment 4 #19 Rl R2 R3 R4 

37 51 35 3 



This is a satisfactory item as it stands. It would, however, 
be in a better sequence if it was preceded by the supplementary note 
on tension and by problem #11, and then followed by problem #18. 

T© 13 



Segment 4 #21 Rl R2 R3 R4 

53 58 15 0 



This item is valid, however the statement of the problem is in- 
complete; i.e., it relies heavily on the diagram, and in doing so it 
may become ambiguous. 

Alternate answer C may be considered invalid. 

It is recoramended that the statement of the problem be rephrased 
and alternate answer C be replaced. 

^0 16 



Segment 4 #22 Rl R2 R3 R4 

62 50 11 2 



Alternate choice "C" of this item is confusing and ambiguous. The 
d.tem becomes wholly satisfactory when choice "C" is replaced by "none 
of the above". 

m 16 
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Segment 4 #24 R2 R3 R4 

63 6 0 3 

« 

This item is a mathematical exercise which should be placed 
elsewhere in the course. 

TO 13 



Segment 5 #3 R2 R3 R4 

• • 38 37 33 12 



Additional phrasing, and some rephrasing, of both this problem 
and its solution,' have been done to help in the student's understanding 
and avoid possible misinterpretations. 

TO 14 



Segment 5 #4 Rl R2 R3 R4 

48 36 26 9 



This item has been omitted. Other existing problems give better 
TO support. 

TO 17 



Segment 5 #8 Rl" R2 R3 R4 

58 38 20 2 

'A few small changes have been made in this problem so that it now 
reads "cleaner" and uses ntanbers which work "cleaner". 

TO 17 
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Segment 5 #9 



Rl R2 R3 R4 
60 37 16 4 



The original problem was essentially good. The solution has 
undergone partial rephrasing primarily to read better. 

TO 14 



Segment 5 #10 Rl R2 R3 R4 

58 36 13 7 



While this item remains unchanged, several phrases have been added 
for its clarification. 

In the new segment this item will be followed by the enabling 
problems 15, 16 and 25. 

TO 14 



Segment 5 #11 R2 R3 R4 

80 24 6 2 



This item has undergone what at first seems to be extensive revision. 
Actually, it remains very much the same problem, but extraneous information 
has' been eliminated. 

The explanation has been improved by the addition of an explanatory 
note and an intermediate algebraic step. 

TO 14 



Segment 5 #13 R3 R4 

95 13 1 1 

The old version of this item was unnecessarily wordy. The item 
has been rephrased to read smoother, and to incorporate the revision 
of item 11, for which it now serves as an enabling problem. 

TO 13 
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segment 5 #14 Rl f R3 R4 



A valid item which has been improved by rephrasing, to eliminate 
redundant information, so that it now reads more easily. 

Its solution has been modified to be independent of the solution 
to problem 8 for which it has become an enabling problem. 

TO 17 



S.g^nt 5 «5 |1 II « f 



A valid question which essentially required no change for the 
new study guide. 

TO 14 



Segment 5 #16 Rl R2 R3 R4 

^ 51 40 15 3 



In this item, force units were changed to agree with convention, 
and considerable rephrasing of the correct explanation has been done 
to aid the student's understanding of this type problem. 

TO 14 



Segment 5 #17 Rl ^2 R3 R4 



This problem is too trivial to be saved for the new study guides 
Better problems are' used to support the TO. 

TO 14 
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Segment 5 #18 



Rl R2 R3 R4 
88 19 0 2 



Item has been omitted. Other problems better support the TO. 

TO 14 



Segment 5 #19 Rl R2 R3 R4 

60 36 8 1 • 



Item has been eliminated for its redundancy. Other problems 
support the TO. 

TO 17 



Segment 5 #20 Rl R2 R3 R4 

. 44 42 16 2 



Original question could be atiswered intuitively and thus did not 
test required skill. Therefore, it was changed to require a numerical 
response. Its position, too, was improved by placing it earlier in 
the segment, since it is supported by old problems 7 and 14. 

TO 17 



Segment 5 #21 Rl- R2 R3 R4 

49 43 7 0 



In this item sevse-- " '-ate choices could be considered re- 
dundant. The question,, i , ql course the solution, were modified 
into a true-false format, and rpositioned in the segment. 

TO 17 ' 
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Segment 5 #22 



Rl R2 R3 R4 
42 25 20 10 



This problem has been omitted since its TO is supported by other 
problems. 

TO 14 



Segment 5 #23 Rl R2 R3 R4 

35 36 20 4 



Although this is a valid question it has been omitted. Its TO 
is supported by other questions. 

TO 14 



Segment 5 #24 Rl R2 R3 R4 

39 27 17 10 



The nature and content of this question required placing it for 
enrichment. 

TO 17 



Segment 6 #5 ^1 R2 R3 R^ 

57' 19 10 3 

This item has been omitted due to its lack of support for 
the TO. 

TO 18 
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Segment ■ 



Rl R2 R3 R4 
49 35 5 0 



T*'"'"-''- ?a has been omitted due 

TO 18 

Segment c 

Thlti has been omitted due 

TO 18 

Segment % -t'- 

Ttfa&s iifct' has been discarded. 

TO 18 

Segment 6 #12 

This item has been omitted due 

TO 19 



to its lack of support for the T.O. 

RI R2 R3 R4 
Se 14 7 6 

to its lack of support for the T.O. 

Rl R2 R3 R4 
56 20 2 0 

It does not support the TO. 

Rl R2 R3 R4 
5S 13 1 1 

to its lack of support for the TO. 
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S 6 #13 



SI R2 R3 R4 
*n 38 23 -1^ 



ERIC 



.As originally ^JEcrdecl , the statement ax ^ ivi problem Is confusing 
-"i-i sustain incorr set ^nrmcepts. 

Jo overcome the^s^ difficulties, the ir?2:rrniHs been restated in. 
licit manner, an appropriate set ^^'^ aisswers. 



SH^t 6 #14 Ri R2 R3 R4 

53 8 6 2 



Item 14 contains concepts and informaliion needed in the solution 
xxxf t^em 13. Therefore, their order has been interchanged. 



Segmmt 6 #16 Rl R2 R3 R4 

38 22 3 1 



Except for a few additional clarifying phases, this item remains 
valid and otherwise unchanged. 

3D 19 



.SegB«^t6#17 Rl R3 R4 

29 22 10 2 



Ihis item has bee3r::iEmoved since jiar:is a problem in Newton's 
SffiEEntZLaw of motion anxLiES. out of placef in this segment. 

W i2 



El :R. R3 R-^ 
5 lo 27 U 



.mtc±±n^az the item iis confusing, "it has been reESveud and 
rpp lprr ^d se o^- item. 

TO 1? 



Segment. EL R2 R3 

12! 21 21 5 



TEiEte rsET is valid and rcsis been xatiained . Howew^-:, since 
proKLenn 711 ::^^^ixis concepts ii^sful in tfce solution of :-sds item, 
theix secj^s:^ nas been intErrrhaiiged. 

TO 159 



Segment 6. ^ R2 R3 R4 

17 IS 13 11 



A trails item but lis ox±ginal qccestlon was vaguHX^r-rmniied. The 
questMi?v feas iffisn imprcjced and, sinceidt contains conce^rts- imseful to 
the selii^tiom zs£ item 20,. their order has been interchan^d. 

TO 19 



Segment 6 #22 Rl R2 :E3 B4 

15 -31 H 2 



Hiisf tipffiSBtion has beeaxTremoved finiam- segme 6 but igHl.amejg for 
enrichment?.' 

TO 19 
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Segment 6 #23 



Rl R2 R3 R4 
25 19 10 5 



Question is valid and, with a smaLL.±2is.tr'rt:iirrR for clarification, 
has been retained for the new segment. 

TO 19 



Segment 6 #24 Rl 1R2 R3 R4 

1j& 14 20 8 



Problem 24 is too similar to 16 and i±i^.\^.C-3Cs is omitted for its 
redundancy. 

TO 19 



Segment 7 #7 Rl R2 R3 R4 

32 58 22 8 



To eliminate possible confusion over t^maiitity of mass, the question 
has been rephrased using the symbol 'V. WoErSng of the solution also 
has been improved. 

TO 20 



SegnnEnt 7 #8 Rl , R2 R3 R4 

36 32 26 27 



Entire rephrasing of this problem has Bnen .^cam in a manner which 
now suggests the sequence of steps for its sirL 

TO 20 
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Segmen± 7 #9 



HI E2 R3 R4 
i55 37 33 16 



A valid question, *iixt (mbl wrxinh may hsssre festr -riiHi ^terpreted by 
l±e-:rHader- The questxrm has' %=rPn entirely restratec! fax the new seg- 
-mPTTtr :snd appropriate cbamges mafe im the sdLT Tt TFj ro n. 



TO 21 



Segnnent 7 #10 21 R2 R3 R4 

43 36 26 14 



A valid question xdaiciL, w±th just a sli^t cfenge xif wording, 
remains for the ne^ segment, 

TO 21 



Segment 7 14 KL :R2 R3 M 

33 29 30 211 



Clttestlon is entirely satisfactory as originally stated. Xt hs 
"been retained wiicaiout ch^ng". Performance data fis attributed pritmarily 
to other factors indicated:. 

TO 23 



Segnf^ 7 #16 ^ R2 BS R4 

42 22 K 7 



The statement rcjE^ this :ffinifis^ now speciSfis time dSarectiort txs":t^s^ 

?ffiwr- the proper siJ^Iutdrai:. Ife aiBwer has heen esntxreL^/ rfir-writtem. ticy 
Jincux-p orate the pareiEacred snifanltion. 

TO 23 
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3egiH=rzT #18 



El R2 R3 R4 
16 26 12 8 



i nn fes been rj- iplased tc be moce closely alligned with its 
-y\. --ipg soiuticnn also zi.:. i&en extensively r-nphrased and clarified. 



SegmffiEl- 7 #!L9 Rl R2 R3 S4 

25 25 7 0 



•Thp- ortl^ significant ciange made ±ti inis -valid question is from 
a inu3ot%ilB cbroice to complstLon type . 

ID 23 



Segmemtt 8 » 1^1 R3 R4 

49 3(P 13 6 



laiis litem lias bsEE- fiamiitted fasr being an insslid questiom on the 
steBBCed TO. 

W 25 



Jtoenfc B #5 Rl R2 R3 R4 

25 32 29 10 



.ISas iitsn has Tieajr. retained for the tissr study ^uide. An infor- 
BrtSSEoa jarnel will clari^ xelations betweea jfesrce and potential needed 
tax tafee soltiitiion of tSiis iSftprtr. 

19 2& 



Er|c -128- 



S^ment 8 #6 m R2 R3 R4 

38 38 12 4 



Item hz^ hez:^ eLirdriated fronn the new seigmEirt. 



TQ 26 



Segmetit 8 #7 



HI K2 R3 E4 
33 41 13 1 



This proibleHnsiitli slight imdi£icat±QaiEB,, i.e^-, a laore explicitly 
stated force amd cniEoletiom format, has iseHii reta±eed £or the new 
sfiguient , 

1» 26 



Segmeut S 



ML R2 K3 H4 
39 34 13 1 



Atti X2n;«ili3l Typ"^^ !;™ which does not .ntarp iKmctr tfe TO. It is onnitted 
t3t»fe new stuEiy gmide- 



HM 2 6 



S^etit 8 ^9 



Rl R2 R3 K4 
36 41 13 1 



4 Htkltd itmi ^•ftisch ^fe*s b«en T&ad^ wsar^ x^l^py^mt by res-j§eifying 
tthe liQV^ acting itt t^nBS M . 



m 26 
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Segment 8 Si S2 R3 E4 

45 24 9 9 



A classic p-Etoblem, it remains umchanged for ths new situdy guide. 

TO 27 



Segmemt 8 #12 Rl R2 R3 R4 

35 35 14 0 



With a isnlnoT change iin the drawing to avoid possible confusion 
and! conversioa to a completion problem, this item is retained for the 
new study guide. 

TO 27 



SegmearE 8 #15 Rl R2 R3 R4 

35 15 15 19 



TSiis item is xbow a conngilffltioEi tj^e anfi luzs been extensively 
rephrased for clariS-catiora. 

TO 27 



SeanEfllt ¥ #16 Rl R2 R3 R4 

29 9 4 5 



Item is entirely satiscEactoiry and remaina; amachanged for the new 
study gui<ie. 

TO 27 
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Segment 8 #18 



Rl R2 R3 RA 
10 3 2 2 



Item lacks relevance to the TO and therefore has been omitted. 

TO 25 



Segment 9 #1 ^1 R3 R4 

® 53 16 2 0 



This item has been omitted since it contains an invalid premise 
in the "Correct" choice. 

TO 28 



Segment 9 #8 Rl R2 R3 R4 

^ 46 22 2 3 



This is a valid and entirely satisfactory item which has been 
retained for the new segment. 

TO 28 



Segment 9 #9 Rl R2 R3 R4 

^ 36 28 5 0 



This question is one of pure mathematics, and not supportive of 
the TO. Therefore, it has been eliminated. 

TO 28 
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Segment 9 #10 



Rl R2 R3 R4 
39 14 9 5 



This question is beyond the level to the study guide and has 
therefore been omitted. 



TO 28 



Segment 9 #11 ^ R2 R3 R4 

^ 38 23 5 1 



In the drawing pertaining to this problem a massless rod 
connected two masses together. The rod was removed from the drawing 
to avoid possible caonfusion. 

TO 29 



Segment 9 #12 Rl R2 R3 R4 

^ 30 25 6 1 



Modification of problem II of this segment would make this one 
a redundant item. Therefore, it has been removed. 

TO 29 



Segment 9 # 13 Rl R2 R3 R4 

^ 34 20 4 2 



If the student assimed' the plane to be stationary, then alternate 
answer "C" would also be correct. This possible asaimption is eliminated 
by the insertion of the word "moving" into the statement of the problem. 



TO 29 



Segment 9 #14 



Ri: R2 R3 R4 
12 24 9 14 



This question involves two masses, one of vhich moves with a 
motion which is poorly specified. The question has been rephrased 
to eliminate this confusion. 

TO 29 



Segment 9 #15 Rl R2 R3 R4 

17 13 13 14 

This item has been eliminated since it is not relevant to the 
study guide. 

TO 29 



Segment 9 #16-24 Insufficient Data 



These questions are review questions and consequently there is 
insufficient data for their validation. All of these items are omitted 
from the new study guide. 
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Segment 10 #3 



Rl R2 R3 R4 
66 36 15 6 



The mathematics for the solution of this problem is too difficult 
for the physics involved. This problem has been changed entirely to make 
its solution more appropriate. 

TO 30 

Segment 10 115 Rl R2 R3 R4 

56 21 28 9 



Question remains unchanged except now it is a completion question. 

TO 30 



Segment 10 //14 Rl R2 R3 R4 

34 20 9 7 

t 

Another question of mathematical acuity. Eliminated from the new 
study guide. 

TO 32 



Segment 10 //15 Rl R2 R3 R^ 

26 43 23 27 

This item was eliminated for a multitude of reasons. It is not self- 
contained (i.e. refers to a drawing in a textbook); it is not a good physics 
problem; and it does not support the T.O. 

TO 32 



Segment 10 #16 Rl R2 R3 R4 

42 34 22 12 



Same comments from item 15 apply. 

TO 32 
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Segment 10 //17 



Rl R2 R3 R4 
76 16 13 2 



Since the solution of this question is based upon a physics principle 
outside the scope of this course, it has been removed from the study guide. 



TO 31 



^ -rn yf-ro Rl R2 R3 R4 

segment 10 //19 3^ 20 



This item has been changed to the completion format and moved to the 
beginning of the segment. Otherwise its content remains unchanged. 

TO 30 



segment 10 ,20 - R3 



This question has been omitted since the T.O. it supports has been 
omitted. 

TO 31 



e«,™o„^ m #91 Rl R2 R3 R4 

Segment 10 #21 17 7 



Revision of this item to improve it has made the question redundant. 
Therefore it has been omitted from the new study guide. 

TO 31 



Rl R2 R3 R4 
33 21 21 28 



Segment 10 #23 

This question has been eliminated in favor of better questions which 
support its T.O. 

TO 33 * 
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Segment 10 //24 



Rl R2 R3 R4 
57 39 4 2 



This item has also been eliminated in favor of better questions which 
support the T.O. 

TO 33 
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Segment 11 iH 



Rl R2 R3 R4 
60 39 10 5 



A valid, satisfactory question which has been retained unchanged for 
the new study guide. 

TO 34 



Segment 11 H Rl R2 R3 R4 

35 65 7 7 



With a trivial label change in the diagram and change in format to 
completion type, this question remains. 

TO 35 



Segment 11 1f6 • Rl R2 R3 R4 

47 14 9 10 



In the old study guide item 6 depends on the data from item 5. In 
the new study guide, items 5 and 6 are widely separated. Therefore data 
from 5 has been re-tnritten and included in 6. 

TO 34 



Segment 11 iH Rl R2 R3 R4 

60 36 10 7 



The statement of this question has been entirely rephrased to eliminate 
possible confusion with it. 

TO 33 



Segment 11 #8 Rl R2 R3 R4 

33 22 12 4 



This question is about kinematics and is not pertinent to the T.O. 
Therefore it has been removed. 

TO 6 
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Segment 11 #9 



Rl R2 R3 R4 
43 6 6 4 



This question is about kinematics and is not pertinent to the T.O. 
Therefore it has been removed. 

TO 34 



segment 11 #10 Rl R2 R3 R4 

32 16 8 2 

This question is about kinematics and is not pertinent to the T.O. 
Therefore it has been removed. 

TO 31 

Jtement 11 #11 Rl R2 R3 R4 

26 15 14 18 



The question has been extensively rewritten to eliminate irrelevant 
information and avoid any possible earlier confusion with it. 

TO 31 



Segment 11 #12 Rl R2 R3 R4 

75 27 11 1 



This question on Newton's third law is out of place in this segment. 
It has been omitted from the new study guide. 

TO 36 ^ 



Segment 11 #13 Rl R2 R3 R4 

61 44 4 4 



Since the correct answer to this multiple choice problem is "none of 
the above" the student learns nothing new from having worked on this question. 
Therefore the question does not remain. 

TO 36 
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Seisaic 11 #14 Rl R2 S3 R4 

61 21 19 11 



The question is too trivial to do justice to so important a topic 
(as ssmservation of momentum certainly is) that it has been removed in favor 
of bE£±rer questions. 

TO 36 



Segment 11 #15 Rl R2 R3 R4 

^ 40 44 14 14 



Tlfcis quesESmm also has besn omitted since it is confusing and serves 
no j-m i H i it*"-^ in tfEE study guide. 

TO W 



Sego^XL #16 Rl R2 R3 R4 

78 20 5 3 



'Stme the xnformation obtained from this problem is not an objective 
of tSs^ -ouarse the jnroblem has been omitted. 

TO 37 



11 #17 Rl R2 R3 R4 

72 31 2 0 



Question has been reworded for clarification. 

TO 37 



Segment 11 #18 Rl R2 R3 R4 

55 32 11 5 



Several clarifying phrases have been added to this problem to avoid 
misinterpretations by the students. 

TO 37 
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Segment 11 #19 



Rl R2 R3 R4 
34 45 21 3 



Question is satisfactory in original form and will be used without change 

TO 37 



Segment 11 #20 Rl R2 R3 R4 

^ 46 37 16 2 



This item has been used as aa. ffia^Tng question for the new segmeast 12, 
Other questions adequately suppoxir ICSifeini-O. 

TO 37 



Segment 11 #22 Rl R2 R3 R4 

^ 28 7 6 1 



This item has been used for an enabling question in the new segment 12. 
Other questions adequately support tMs T.O. 

TO 37 



Segment 11 #23 Rl R2 R3 R^ 

18 16 5 3 



This item has been used for an enafilir^ ^gaestion in the new segment 12. 
Other questions adequately support th±S-X.-0. 

TO 37 



Segment 11 #24 Rl R2 R3 R4 

• 33 5 4 0 

With extensive rephrasing of the solution, this item remains in the 
new study guide. 



TO 37 



Segment 12 #4 



Rl R2 R3 R4 
18 8 6 16 



Except to clarify that the solution has been done in terms of cons;erva 

tion of momentum, and to be a compiEisrion question, this problem remains oi±er 
wise unchanged. 

TO 37 



Segment 12 #6 R3. .S.4 

46 3GM- S 



Chsnging this question to i^caoitqjLesrijim type is exttitsly ^irLsfacrary 
for tie nastf study gm±Bs.. 

TO 38 



Segment 12 #7 Rl R2 R3 R4 

27 31 18 16 



Removed from study guide and placed as an enrichment question. 

TO 38 



Segment 12 #8 Rl R2 R3 R4 

27 ID 4 1 

This item also has been remo:w^ed from the ?study guide and held for 
enrichment. 

TO 38 



Segment 12 #9 • Rl R2 R3 R^ 

21 14 1 2 

This item has been removed from the study' guide and placed as an 
enrichment question. 

TO 38 



Segmnnt 12 //12 - 16 



These questicms on iijipulse-momentum theorem are misplaced being in 
tills segment • They ":iave th^efore been fitted. 



#12 = 


TO 


33 


#13 = 


US) 


31 


#14 = 


'TD 


36 


#15- 


TO 


36 


ms = 


TO 


m 



segment 12 #17 S u f f 

This itsn has been removed in favor of others which better substan- 
tiate the'T.O, 

TO 32 ' 



segment 12 #18 Sf^f 

This item is entirely satisfactory in its original form and remaixs 
unchanged (exo^jit oi»e typographical error) . 

TO 37 



c^^oT1^ 19 Rl R2 R3 R4 

Segment 12 #19 n IQ 8 Q 



This item, without change, has been placed in the enrichmeat sect inn. 

TO 37 
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Segnsent 12 #20 



Rl R2 R3 R4 
14 6 1 1 



This question does not substantiate the T.O. for this segment 
thus has. "been eliminated. 

TO 37 



^ n ^^n^ Rl R2 R3 R4 

Sesmarxt 12 #21 10 8 2 0 



Hhis question was not used since ocher questions were preferred for 
the T.O.. 

TO 38 



* n Jloo OL Rl R2 R3 R4 

Segment 12 #22 - 24 ^^^^ 3 3 0 0 

#23 3 3 0 0 

m 4 110 



These items wene imvalidated for Isck of support of basic concept 

of T.O. 

#22 T.O. 153 
#23 T.O. 153 
#24 T.O. 153 



ERIC 
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Segment 13 #1 



Rl R2 R3 R4 
83 20 7 6 



Performance data is satisfactory, however the content is sufficiently 
covered in the new infonsiat±an panel. 

T.O. 39 



Segment 13 #2 ^ ^ ^3 R4 

^ 19& . 3 0 



Information contained in this item will be cove r m f^^ ^ewhere in the 
new study guide. 

T.O- 39 



<n^^^„^ TO yto Rl R2. R3 R4 

Segment 13 #3 4 3 



Information content of this jnroblem will be oroered in the 
infomation panel.. 

T.O. 39 



Segment 13 H ^^ .^ _ 



This item lhas been omitted since the T'.O. is better supported in 
another problem. ^ 

T.O. 40 



Er|c 



Segment 13 #5 



Rl R2 I<3 R4 
90 16 6 4 



This item has been omitted since its T'.O. is of very low priority. 
T.O. 40 



Segment 13 #6 RI R3 R4 

3S ; 27. 19 32 



This question has been omitted since it is confusing and the "correc 
answer is partially incorrect and therefore argumentative. 

T.O. 40 



Segment 13 #7 Rl - R^ R3 R^ 

49- 26 10 5 



This question has been improved primarily through extensive added 
phrasing to make the solution significantly more informative. 

T.O. 41 



Segment 13 #8 RI - R2 - R3 R4 

82 . la 22 7 



Except for changing tinits to agreed convention this problem remains 
essentially unchanged. 

T.O. 40 



-m.5-- 
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Segment 13 #9 



Rl R2 R3 R4 
57 29 22 7 



The problem was rephrased to be self-contained for the new segment. 
T.O. 41 

Segment 13 #11 RI R2 R3 R4 

43 . 36 29 7 

Problem was omitted as it lacked support for T.O. 
T.O. 19 

Segment 13 #12 Rl - R2 R3 R4 

87 20 6 2 

With the addition of several explanatory phrases, this problem 
is satisfactory for the new segment. 

T.O. 41 

Segment 13 #13 Rl R2 R3 R4 

75: 27 9 2 

Question has been omitted since it" lacks support for the T.O. 
T.O. 42 
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Segment 13 //14 



Rl R2 R3 R4 
62 37 12 1 



With some notation changes to avoid ambiguities, this item is 
satisfactory for the study guide. 

T.O. 43 



Segment 13 #15 Rl R2 R3 R4 

37 29 21 26 



Addition of this question would place too much emphasis on the 
distinction between inertial and gravitational masses and may cause 
confusion at this level. Therefore, this problem has been omitted. 

T.O. 43 



Segment 13 #16 Rl R2 R3 R4 

27 29 28 27 



Addition of this question would place too much emphasis on the 
distinction between inertial and gravitational masses and may cause 
confusion at this level. Therefore, this problem has been omitted. 

T.O. 43 



Segment 13 #17 Rl R2 R3 R4 

88 18 3 0 



With the change of format to true or false the question has been 
appropriately rephrased. 



T.O. 42 



Segment 13 //18 



Rl R2 R3 R4 
36 30 28 16 



Now that all data is presented in the same unit system, this 
question is entirely satisfactory. 

T.O. 42 



segment 13 m \ |3 R4 



This problem has been entirely reworded to make explicit some 
assumptions students must make for its solution. 

T.O. 42 



Segment 13 #20 Rl R2 R3 R4 

40 14 10 15 



A valid but somewhat difficult problem, this item has been placed 
for enrichment. 

T.O. 42 



Segment 13 #21 Rl R2 R3 R4 

77 ' 23 4 1 



Since a lever balance actually compares masses, wording was changed 
to clarify that point for the new study guide. 

T.O. 42 " 



Segment 13 #22 

Problem is invalid since it does 
is ambiguous, 

T,0. 44 

Segment 13 //23 

This problem is valid but a bit 
information panel. 

T,0- 44 

Segment 13 #24 

This problem is valid but a bit 
information panel. 

T.O. 44 

Segment 14 //I 

Although a valid question with 
item is out of sequence and does not 

T.O. 45 



Rl R2 . R3 R4 
28 30 27 20 



not support the T.O. and wording 



Ri: R2 R3 R4 
24 63 10 8 



difficult. It is aided by the 



Rl R2 R3 R4 
70 25 8 1 



difficult. It is- aided by the 



Rl : R2 : R3 R4 
46: 47" 11 2 



satisfactory performance data, this 
support T.O.'s of this segment. 



ERLC 



Segment 14 #2 



Rl R2 R3 R4 
45 42 11 2 



ERIC 



With a change in the solution for clarification this question will 
be used for the new version. 

T.O. 45 



Segment 14 #3 RI R2 R3 R4 

61 27 13 2 



An acceptable question with good performance data. 
T.O. 46 



Segment 14 #4 Rl R2 R3 R4 

33 14 10 12 



This question should be combined with question 5 to form a self- 
standing problem. 

T.O. 18 



Segment 14 #5 Rl R2 R3 R4 

42 34 21 5 



This question should be combined with question 4 to form a self- 
contained problem. 

T.O. 46 
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Segment 14 #6 



Rl R2 R3 RA 
52 32 9 5 



ERIC 



With a slight modification of the correct solution this question 
is satisfactory. 

T.O. 46 



Segment 14 #7 Rl R2 R3 R4 

47 25 16 9 



A valid question to be preceded by an appropriate information 

panel. 
T.O. 46 



Segment 14 #8 Rl R2 R3 R4 

19 16 14 10 



A valid question for use in the new version study guide. 
T.O. 46 



Segment 14 #9 Rl R2 R3 R4 

30 31 27 6 



Question Is a simple exercise in calculus. 
T.O. 47 



Segment 14 #10 



Rl R2 R3 RA 
12 30 35 15 



An acceptable question in its present form for the new study guide. 
T.O. 47 



Segment 14 #11 ^2 R3 R4 

^ 19 13 8 11 



No change is required for re-use of this question. 
T.O. 47 



Segment 14 #12 Rl R2 R4 

30 31 22 8 



Does not contribute to understanding of concepts involving gravitation 
and therefore has been eliminated. 

T.O. 48 



Segment 14 #13 Rl R2 R3 R4 

34 - 27. - 19 11 



This is not an appropriate question to convey the principle of 
gravitation and therefore will not be used in the new segment. 



T.O. 48 



Segment 14 #14 RI R2 R3 R4 

3& 25 6 3 



Contains information which is more appropriate in an information 

panel. 
T.O. 48 



Segment 14 #15 RI R2 R3 R4 

IS 32 30 13 



A poor question since it confuses the student in making a choice 
of appropriate coordinate systems in calculating potential energy. 

T.O. 48 



-Segment 14 #16 RI R2 R3 R4 

25 5 7 8 



With modification of the correct answer this question has been use 
in the new version. 

T.O. 48 



Segment 14 #17 ' RI R2 R3 R4 

21. 14 4 2 



A valid item especially as an enrichment question. 
T.O. 48 



Segment 14 #18 



Rl R2 R3 R4 
40 18 18 9 



With a modification of the correct solution this question should 
appear in the new segment. 

T.O. 48 



Segment 14 #19 Rl R3 

21 13 6 3 



This question has been clarified by replacing the phrase "...a very 
short time thereafter" with "instantaneously." 

T.O. 48 



Segment 14 #20 Rl R2 R3 R4 

33 28 20 5 



An acceptable question requiring no change for the new segment. 
T.O. 48 



Segment 14 #21 Rl R2 R3 R^ 

7 13 11 5 



This question is ambiguous and not. relevant to the course level. 
T.O., 48 
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Segment 14 #22 



Rl R2 R3 R4 
12 33 21 15 



A valid question for inclusion in the study guide. Performance 
data is attributed primarily to other factors as indicated. 

T.O. 47 

Segment 14 //23 Rl R2 R3 R4 

17 23 21 20 

Other questions better support the T.O. than this one. 
T.O. 47 

Segment 14 #24 Rl R2 R3 R4 

17 8 3 3 

Too difficult a question to be relevant to the level of the course. 
T.O. 48 

Segment 15 #1 Rl R2 R3 R4 

17 29 28 5 

A valid question which should be included in the new segment. 
T.O. 48 
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Segment 15 //2 



Rl R2 R3 R4 
31 lA 17 16 



With modifications to clarify the question and amplify the solution 
this question will reappear in the new segment. 

T.O. 48 



Sepaent 15 #3 RI R2 R3 R4 

44 18 10 5 



Rewriting the statement of the question makes this a valid core 
problem for the new version segment. 

T.O. 48 



Segment 15 #4 Rl R2 R3 R4 

49 24 2 2 



This question is both redundant and too trivial to be retained. 
T.O. 48 



Segment 15 #5 RI ■ R2 R3 R4 

la 10 3 2 



Omitted since other problems give better T".0. support. 
T.O. 46 



Segment 15 #6 



Rl R2 R3 R4 
16 9 3 2 



Problem would be redundant since the T.O. has been adequately 
supported by other problems. 



T.O. 47 



ic; JJ7 Rl R2 R3 R4 

Segment 15 #7 16 8 3 2 



Problem would be redundant since the T.O. has been adequately 
supported by other problems. 

T.O. 48 



c^^^r,^ ic: jiQ Rl R2 R3 R4 

Segment 15 #8 6 



This question is beyond die scope of ' this course and therefore will 
not appear in the new segment. 

T.O. 48 



Segment 15 #9 ^2 R3 R4 

12-22 24 12 



With minor changes of the wording of 'the correct solution this 
problem is valid for the new segment. 

T.O. 45 



ERIC 



Segment 15 ^10 



Rl R2 R3 RA 
9 7 4 2 



Corrections have been made of the correct solution to make this an 
acceptable problem. 

T.O. 45 



c ^^r,^ 1-; *n R2 R3 R4 

Segment 15 ffll 9 10 1 3 



This is a repetition of qyestiGa 10 <md^ tMpefore has not been 
included in aey version. 

T.O. 45 



Semmt 15 #13 R3 R4 



A redundant item which does not appear in new study guide. 
T.O. 45 



Segment 15 #14 ^2 R3 R4 

^ 44 16 5 5 



Question is not pertinent to T.O. involved and therefore has not 
been used again. 

T.O. 45 
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Segment 15 #15 



Rl R2 R3 R4 
7 14 3 0 



Question omitted since T.O. has been adequately covered by others. 
T.O. 46 



Segment 15 #16 Rl R2 R3. R4 

^ 11 5 3 3 



A valid question needing only amplification of the solution to be 
retained in the segment. 

T.O. 48 



Segment 15 #17 Rl R2 R3 

13 4 2 3 



With slight modifications of alternate answers B and D, and of the 
solution this problem is acceptable for use in the new segment. 

T.O. 48 



Segment 15 #18 Rl R2 R3 R4 

13 2 2 0 



A. redundant question to be omitted from new version. 
T.O. 48 



ERIC 
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Segment 15 #19 



Rl R2 R3 R4 
6 3 4 1 



Correct solution has been modified to make this a more infortaative 
problem in the study guide. 

T.O. 48 



Segment 15 #20-24 Insufficient Data 



Best suited for enrichment section. 
T.O. 154 



Segment 16 #1 Rl R2 R3 R4 

^ 99 12 3 0 



Choice D was not an effective distractor. Change as shown. 
T.O, 49 



Segment 16 #2 RI R2 R3 R4 

55 39 17 3 



With some rewriting of the statement "charge is quantized", this 
problem should remain otherwise unchanged. The explanation should be 
amplified. 

T.G. 49 
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Segment 16 #3 



Rl R2 R3 R4 
100 7 4 3 



A valid item, but needs some rewriting to increase differences 
between alternate choices. 

T.O. 49 



Segment 16 #4 R2 R3 R4 

87 20 4 3 



This T.O. is better supported by other, more pertinent problems. 
T.O. 49 



Segment 16 #5 Rl R2 R3 R4 

90 19 4 0 



A valid item and necessary to the solution of coulomb forces- 
T.O. 49 



Segment 16 #6 Rl R2 R3 R4 

87 19 4 3 



A valid item and necessary to the solution of coulomb forces. 
T.O. 49 



Segment 16 #7 



Rl 
96 



R2 R3 R4 
12 3 2 



A valid question. Should remain unchanged. 
T.O. 50 



^ ifi yiR Rl R2 R3 R4 

segment 16 #8 100 7 1 2 



T.O. has been adequately supported by other problems. The question 
will be used in enrichment section. 

T.O. 50 



Ga«™a„^ ifi na Rl R2 R3 R4 

Segment 16 //9 96 8 4 5 



T.O. has been adequately supported by other problems. The question 
will be used in enrichment section. 

T.O. 50 



Segment 16 iHO Rl R2 R3 R4 

^ 102 9 1 0 



This question compares quantity of charge to the flow of current and 
therefore is out of place in this segment on Electrostatics. 

T.O. 51 
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Segment 16 #11 



Rl R2 R3 R4 
82 24 3 3 



A valid item, highly supportive of the T.O., should remain 
unchanged. 

T.O. 51 



o . ^c R2 R3 R4 

Segment 16 #12 49 46 9 8 



This item is concerned with forces in terms of field strength 
and therefore is out of place in this segment. 

T.O. 52 



c=„,n«r,«- ^(. Rl R2 R3 R4 

Segment 16 #13 u 9 



This item is concerned with forces in terms of field strength 
and therefore is out of place in this segment. 

T.O. 52 



ifi i^^L Rl R2 R3 R4 

Segment 16 #14 3^ 



This item is concerned with forces in terms of field strength 
and therefore is out of place in this segment. 

T.O. 52 
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Segment 16 //15 . Rl R2 R3 R4 

37 23 33 18 



Not valid. Correct answer not shown. Change to more believable 
numbers. The solution needs to be remedied. Its procedure is correct 
but the answer is not. This would account for the response data. 

T.O. 49 



Segment 16 #16 RI R2 R3 r4 

58 34 10 8 



Problem does not support T.O. and has been omitted. 
T.O. 49 



Segment 16 #17 Rl R2 R3 R4 

39 55 12 3 



Other problems better support the T.O. 
T.O. 54 



Segment-^ie #18 Rl R2 R3 R4 

/ N, 62 38 8 1 



Appropriate T.O. has been adequately represented by other problems, 
T.O. 54 



ERIC 
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Segment 16 //19 



Rl R2 RJ R4 
79 24 3 3 



Problem should be eliminated since other items support T.O. better, 
T.O. 54 . 



Segment 16 #20 Rl R2 R3 R4 

94 13 0 2 



A good question on conservation of charge. Distractors should be 
changed as indicated to reduce triviality. 

T.O. 54 



Segment 16 #21 Rl R2 R3 R4 

63 19 15 13 



A good question on conservation of charge. Used for core question. 
T.O. 54 



Segment 16 #22 Rl R2 R3 R4 

92 16 0 1 



A good enabling question, requiring basic concepts of charging 
by conduction, and repulsion of like charges. 

T.O. 54 
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Segment 16 #23 



Rl R2 R3 RA 
62 32 9 6 



A valid item, requiring a knowledge of charging by induction and 
conduction, plus determination of nature of a charge. To be used in 
enrichment section. 

T.O. 54 



Segment 16 #24 Rl R2 R3 R4 

95 8 4 3 



A valid item, requiring a knowledge of charging by induction and 
conduction, plus determination of nature of a charge. To be used in 
enrichment section. 

T.O. 54 



Segment 17 #4 Rl R2 R3 R4 

47 44 14 0 



A valid question which requires some rearrangement of its form. 
T.O. 53 



Segment 17 #5 Rl R2 R3 R4 

42 32 25 6 



This' question is suitable in original form. 
T.O. 53 
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Segment 17 #6 



•Rl R2 R3 R4 
50 39 14 2 



Question is poorly worded and too confusing to the student to be 
included in the new segment. 

T.O. 53 



Segment 17 //8 Rl R2 R3 R4 

56 40 6 1 



Question is valid but unclear. Requires some rephrasing to be saved 
for new segment. 

T.O. 55 



Segment 17 #12 Rl R2 R3 R4 

26 29 29 16 



An already acceptable example of a classical problem. 
£.0. 53 



Segment 17 #14 Rl R2 R3 R4 

29 37 20 12 



Although a valid question, it should be preceded by simpler questions, 
accomplished by placing this one in a later segment. 

T.O. 53 . 
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Segment 17 #17 Rl R2 R3 R4 

34 28 21 12 



An acceptable question in its present form. 
T.O. 53 



Segment 17 #18 .. Rl R2 R3 R4 

45 36 10 3 



With a modification of the correct solution, this question becomes 
acceptable for the new segment. 

T.O. 53 



Segment 17 #20 Rl R2 R3 R4 

31 51 7 4 



Does not lend, support to T.O. and should be omitted. 
T.O. 55 



Segment 17 #21 Rl R2 R3 R4 

27 32 23 12 



Question is poorly stated. Since other questions adequately 
support the T.O. this one has been omitted. 

T.O. 55 
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Segment 17 #23 



Rl R2 R3 R4 
28 50 10 6 



Question is of a nature which is not relevant to this part of course. 
T.O. 55 



Segment 18 #6 R2 R3 R4 

. 41 26 28 13 



Since the pertinent T.O. has been removed from this segment this 
problem will be used for enrichment segment. 

T.O. 57 



Segment 18 #11 Rl R2 R3 R4 

35 53 19 3 



The correct answer was incorrectly stated to be choice A instead 
of C. This would account for the poor performance indicated by the 
data. Otherwise, this is a valid item. 

T.O. 56 



Segment 18 //12 Rl R2 R3 R4 

" 52 36 16 5 



An acceptable question in its present form for the new segment. 
T.O. 56 
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Segment 18 //13 



Rl R2 R3 R4 
42 41 16 11 



A valid itea which does not require changes or modifications for 
the new segment. 

T.O. 58 



Segment 18 //lA Rl R2 R3 R4 

40 39 16 13 



Pertinent T.O. has been removed from this segment. Therefore, this 
problem will appear in the enrichment segment. 

T.O. 58 



Segment 18 #17 Rl. R2 R3 R4 

36^30 14 26 



Question is poorly worded and may tend to confuse students. Therefore, 
"it has been omitted from the segment. 



T.O. 58 



Segment 18 #18 Rl R2 R3 R4 

18 36 46 6 



A poorly worded question, whose T.O. has been moved to the 
enrichment section, finds itself. also so moved. 

T.O. 59 
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Segment 18 #22 



Rl R2 R3 R4 
52 47 2 1 



This item is out of sequence if placed in this segment. 
T.O. 49 



Segment 19 //2 Rl "^2 R3 R4 

41 : 17 2 



A valid question, applicable to the new version segment. 
T.O. 60 



Segment 19 #6 Rl R2 R3 R4 

35 33 17 15 



This item is most appropriate in a segment on work and potential. 
T.O. 63 



Segment 19 if7 Rl R2 R3 R4 

48 29 17 7 



A good example of one of those classical problems in this area 
of study. 

T.O. 60 



ERIC 



171- 



Segment 19 #8 



Rl R2 R3 R4 
3S 36 16 6 



An acceptable problem which is out of place in this segment, 
T.O. 62 



e •.=r-^ 10 #10 Rl R2 R3 R4 

49 44 5 0 



No change is required in this acceptable problem. 
T.O. 61 



Segment 19 #12 Rl R2 R3 R4 

43 40 12 2 



Acceptable for new segment in this present, form. 
T.O. 61 



Segment 19 #15 Rl R2 R3 R4 

. 37 25 18 11 



A valid item for re-use in the new segment. 
T.O. 52 
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Segment 19 #16 



Rl R2 R3 RA 
33 26 8 22 



Use of this item is not valid. It is duplication of a question 
the segment on gravitation. 

T.O. 41 



Segment 19 #17 Rl R2 R3 RA 

34 37 12 5 



This item properly belongs in the segment on work and potential. 
T.O. 63 



Segment 19 #18 Rl R2 R3 R4 

27 16 24 23 



With tf^e omission of the phrase "neglect relativistic effects" 
this problem will be used in the new segment. 

T.O. 61 



Segment 19 #19 Rl R2 R3 R4 

22 26 20 17 



A problem requiring no changes for its re-use. Performance 
data is attributed primarily to other factors as indicated. 

T.O. 61 
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Segment 19 #20 



Rl R2 R3 R4 
36 20 17 10 



A question too sophisticated for this level course. Place in 
enrichment section. 

T.O. 63 



Segment 19 #21 Rl R2 R3 R4 

42 22 15 6 



A good question in its present form for re-use. 
T.O. 60 



Segment 19 #23 Rl R2 R3 R4 

41 28 11 6 



Question is poorly worded and confusing to the students. Omitted 
from new version of the segment. 

T.O. 62 



Segment 19 #24 Rl R2 R3 R4 

42 19 15 10 



Item does not test for comprehension of the desired T.O. and thus 
has been omitted. 

T.O. 52 
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Segment 23 #8 " RJ R2 R3 R4 

Item valid. Question valid. 



41 /17 22 23 



Segment 23 #11 Rl R2 R3 R4 

^ 41 51 8 3 

Item valid. Quescion valid. Performance data is probably due 
to other factors as indicated. 



Segment 23 #13 Rl R2 R3 R4 

^ 38 52 11 2 

Item valid. Question valid. Omit, as there are too many 
redundant flux questions in this segment. 
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Segment 2A #1 



Rl R2 
40 39 



R3 R4 
10 4 



Item valid in present form requiring no modifications, 
T.O. 67 



o/ nn Rl R2 R3 R4 

Segment 24 ffy ^3 31 17 3 



The problem now includes the charge on an alpha particle which 
students had been expected to know. 

T.O. 68 



. 0/. JHO R3 R4 

Segment 24 ffl2 4 



The relevant T.O. has been sufficiently emphasized by other 
questions . 

T.O. 67 



c ^ OA yiift Rl R2 R3 R4 

Segment 24 #18 ^ ^ 



■ This item tests for information too trivial to this segment and 
therefore has been omitted. 

T.O. 69 
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Segment 24 //19 



Rl R2 R3 R4 
31 38 13 5 



A conceptually confusing problem which has been omitted, 
T.O. 69 



segment 24 ,20 |1 ^ R4 



An acceptable problem for re-use in the course. 
T.O. 69 



Segment 24 #21 Rl R2 R3 R4 

^ 35 37 7 9 



Question has been retained since it tests for concepts required 
by the T.O. 

T.O. 68 



Segment 24 #23 Rl R2 R3 R^ 

^ 31 39 13 3 



Essentially, this question duplicates efforts of question 20 
which has been given preference. 

T.O. 68 • 
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Segment 25 #5 



Rl R2 R3 R4 
22 19 14 7 



For irrelevance to the understanding of concepts in this segment 
this question has been omitted. 

T.O. 67 



Segment 25 #9 Rl R3 R4 

21 19 15 7 



Although a valid question, its T.O. has been removed from the segment 
and so, therefore, has this problem. 

T.O. 70 



Segment 25 #10 Rl R2 R3 R4 

■ 27 28 5 3 



Although a valid question, its T.O. has been removed from the segment 
and so, therefore, has this problem. 

T.O. 70 



Segment 25 #12 Rl R2 R3 R4 

23 20 10 9 



Too complex for use as a study guide question. 
T.O. 70 • 
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n^y Rl R2 R3 R4 

segment 25 #13 



Question properly supports T.O. and will be re-used. 
T.O. 52 



c _ 0.; yfiA Rl R3 R4 

Segment 25 #1^ 26 19 16 2 



Omitted since T.O. is adequately treated in other questions. 
T.O. 69 



c , ,c ma Rl R2 R3 R4 

Segment 25 #18 2I 14 6 



With a slight modification of the correct answer, this question 
should be re-used in study guide. 

T.O. 69 



o . oc lim Rl R2 R3 R4 

Segment 25 //21 23 16 12 11 



Correct solution has been modified and clarified so that this 
question may be used in the new version segment. . 

T.O. 68 ' , 
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Segment 26 #14 



Rl R2 R3 R4 
41 35 11 13 



Although a valid question, it has been replaced by a similar 
better worded question. 

T.O. 74 



Rl R2 R3 R4 

Segment 26 //19 21 13 15 13 



Problem is entirely satisfactory in its present form for the new 
segment. 



T.O. 75 



^ rf99 R3 R4 

Segment 26 ?/22 13 11 6 14 



Problem is entirely satisfactory in its present '.orm for the new 
segment. 

T.O. 75 



.OA m-i Rl R2 R3 R4 

Segment 26 //23 13 10 6 9 



Inclusion of this question would be redundant and therefore it 
will be used in the enrichment segment. 

T.O. 75 ■ 
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Segment 27 n 



Rl R2 R3 R4 
23 14 10 22 



A valid item for use. . ■ .n modifications, in the new segment. 
T.O. 76 



Rl R2 R3 R4 

Segment 27 #7 34 22 7 6 



Question contains a process of approximation which would be most 
appropriate in an enrichment segment. 

T.O. 73 



o7 yf8 

Segment 27 ?f» 28 32 6 3 



Rated G. (A good standard problem for inclusion in the study 
guide , ) 

T.O. 73 



nn Rl R2 R3 R4 

Segment 27 ?Ay 25 24 13 7 



Ir. Mston of this p.-oblo.Ti, vould cause redundancy. Therefore, it 
has been omitted. 

T.O. 53 
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Segment 27 #16 



Rl R2 .R3 R4 
33 19 14 3 



A valid question which properly tests the T.O. 
T.O. 78 



Segment 27 #17 Rl R2 R3 R4 

23 25 10 10 



A valid question which properly tests the T.O. 
T.O. 78 



Segment 27 #18 * ^1 ^2 R3 R4 

12 9 2 13 



This quf;fvtxon, although valid, is confusing to the students and 
has been elimiu^iired from the new study guide. 

T.O. 79 



Segment 27 #20 ^1 R2 R3 R4 

11 10 4 8 



With a minor modification this problem is suitable for inclusion 
in the new study guide. 

T.O. 79 • 
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Segment 27 #22 



Rl R2 R3 R4 
16 14 3 1 



Inclusion of this problem could create redundancy. It has therefore 
been eliminated from the new version. 

T.O. 79 



Segment 27 #23 Rl R2 R3 R4 

13 8 3 5 



Use of this question here is not valid. This problem has been 
given in an earlier segment for the calculation of potential difference. 

T.O. 79 



Segment 27 #24 " Rl R2 R3 R4 

12 13 3 1 



A valid question appropriate to the T.O. of concern. 
T.O. 79 



Segment 28 #9 Rl R2 R3 R4 

31 49 17 9 



Alternate answers A and C are too similar in the original question. 
They require modification to make this an acceptable question for the new 
segment. 

T.O. 81 
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Segment 28 #12 Rl R2 R3 R4 

43 23 21 19 



An item requiring no a .ification for re-use. Performance 
data is attributed primarily to other factors as indicated. 

T.O. 82 



Segment 28 #14 Rl R2 R3 R4 

27 59 12 8 



The inclusion of a circuit diagram should prove helpful to the students 
in this problem. 

T.O. 82 



Segment 28 #15 Rl R2 R3 R4 

43 26 17 20 



Inclusion of the appropriate circuit diagram will make this problem 
self-contained. 

T.O. 82 



Segment 28 #17 Rl R2 R3 R4 

22 39 27 14 



Since this question is acceptable, the performance data suggests 
the need for additional problems for practice in the calculation of the 
energy of an electric field. 

T.O. 8?. 
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Segment 28 #18 Rl R2 R3 R4 

43 32 26 4 



A valid problem which does not require modifications. 
T.O. 83 



Segment 28 #19 Rl R2 R3 R4 

48 43 11 1 



This question has been omitted since it contains an ambiguous 
statement and is not pertinent to the subject content. 

T.O. 83 



Segment 28 #23 Rl R2 R3 R4 

36 44 17 3 



A valid question which is pertinent to the T.O, 
T.O. 83 



Segment 28 #24 Rl R2 R3 R4 

• 49 37 10 4 



The question is valid and should be located ahead of items 22 anci 
T.O. 83 
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Segment 29 #2 



Rl R2 R3 R4 
43 28 16 9 



This item does not require modifications to suit new segment. 
T.O. 84 



Segment 29 //3 Rl R2 R3 R4 

47 37 5 7 



T.O. for this question is better supported by question #4 which 
has received preference. 

T.O. 84 



Segment 29 #9 Rl R2 R3 R4 

37 35 14 6 



This item does not require modifications to suit new segment. 
T.O. 84 



Segment 29 #11 Rl R2 R3 R4 

40 37 14 0 



An acceptable question in present form. 
T.O. 84 
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Segment 29 #15 



Rl R2 R3 R4 
15 26 21 25 



Question is acceptable for re-use in the new segment. Performance 
data is attributed primarily to other factors as indicated. 

T.O. 85 



Segment 29 #18 Rl R2 R3 RA 

43 25 12 7 



Question is acceptable for re-use in the new segment. 
T.O. 86 



Segment 29 //20 Rl R2 R3 R4 

17 15 15 8 



A valid question but not pertinent to T.O. It has been moved to 
the previous segment. 

T.O. 82 



Segment 29 #22 Rl R2 R3 R4 

12 17 9 5 



Question is valid but of place in this segment. 
T.O. 83 
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Segment 29 #24 



Rl R2 R3 R4 
16 9 4 4 



Question -is beyond the scope of the couiae and therefore has been 
removed for placement in enrichment- 

T.O. 85 



Segment 30 #7 Rl R2 R3 R4 

39 36 11 10 



Item valid in present form for use in new segment. 
T.O. 88 



Segment 30 #8 Rl R2 R3 R4 

36 26 18 15 



Item valid in present form for use in new segment. 
T.O. 88 



Segment 30 #12 Rl R2 R3 R4 

33 40 12 9 



A valid item which tests concepts pertinent to the T.O. 
T.O. 89 
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Segment 30 #13 



Rl R2 R3 RA 
34 37 11 11 



A good, standard question requiring no modification for its re-us 
T.O. 89 



Segment 30 //14 Rl R2 R3 R4 

48 28 12 2 



A valid item which tests concepts pertinent to the T.O. 
T.O. 88 



Segment 30 //16 Rl R2 R3 R4 

32 12 27 19 



Question has been removed since it is confusing and too trivial. 
T.O. 90 



Segment 30 #21 Rl R2 R3 R4 

41 22 15 9 



A valid problem, requires the rewriting of the correct answer to 
be used in new segment. 

T.O. 90 
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Segment 31 if6 



Rl R2 R3 R4 
37 26 8 8 



A valid question which tests for concepts required for T.O. 
T.O. 91 

Segment 31 //B Rl R2 R3 R4 

40 30 4 3 



A satisfactory question in present form for re-use. 
T.O. 91 



Segment 31 //13 Rl R2 R3 R4 

32 23 6 15 



This question supports the pertinent T.O.' and will be re-used. 
T.O. 91 



Segment 31 #15 Rl R2 R3 R4 

30 15 18 9 



No change is required to re-use this acceptable question. 



T.O. 92 



ERIC 
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Segment 31 //24 



Rl R2 R3 R4 
24 13 6 2 



ERIC 



Question is too tedious and cumbersome for use here. Kirchhoff's 
rules can be learned through much simpler circuits. This problem 
should be used in enrichment. 

T.O. 93 



Segment 32 #2 Rl R2 R3 R4 

19 17 12 2 



A valid quescion. Does not require modifications for re-use. 
T.O. 94 



Segment 32 #3 Rl R2 R3 R4 

18 16 ,9 7 



Question tests for concepts desired for the T.O. and will be 
re-used. 

T.O. 94 



Segment 32 #5 Rl R2 R3 R4 

14 16 15 2 



An acceptable question for re-use without modifications. 
T.O. 94 
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Segment 32 //6 Rl R2 R3 R4 

19 17 7 4 



An acceptable question for ire-use without modifications. 
T.O. 95 



Segment 32 #7 Rl R2 R3 R4 

1^ 12 10 8 



Question tests for concepts required for T.O. and will be re-used. 
T.O. 91 



Segment 32 #8 Rl R2 R3 R4 

21 18 4 2 



A valid question to test for concepts needed for understanding T.O. 
T.O. 95 



Segment 32 #10 Rl R2 R3 R4 

16 7 11 9 



An acceptable question for use in the new version study guide. 
T.O. 95 



-192- 



Segment 32 #13 



Rl* R2 
18 9 



R3 
6 



R4 
3 



Requires no change for use in new segment. 
T.O. 96 



Segment 32 #14 Rl R2 R3 R4 

.16 10 6 1 



A valid question to test concepts necessary for understandins of T.O. 
T.O. 96 



segment 32 #15 Rl R2 R3 R4 

16 5 10 4 



Question in original form is a little too difficult. An illustration 
with some hints for solution will be helpful. 

T.O. 91 : 



Segment 32 #19 Rl R2 R3 R4 

8 8 12 



Although a valid question, this topic was covered in an earlier 
segment and therefore question has been omitted. 

T.O. 93 
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Segment 32 #22 



Rl R2 R3 R4 
5 6 11 



Although a valid question, this topic was covered in an earlier 
segment and therefore question has been omitted. 

T.O. 22 



Segment 33 #2 Rl R2 R3 R4 

32 47 5 2 



A valid question for use in its present form. 
T.O. 99 



Segment 33 #3 Rl R2 R3 R4. 

37 28 15 6 



Slight modifications have been made of the included diagram and 
the correct solution to improve their clarity to the student. 

T.O. 99 



Segment 33 #4 Rl R2 R3 R4 

41 26 9 9 



No changes are required for re-use of this question. 
T.O. 97 
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Segment 33 #5 



Rl R2 R3 R4 
33 39 6 4 



Slight modifications have been made of the included diagram and 
the correct solution to improve their clarity to the student. 

T.O. 100 



Segment 33 #6 Rl R2 R3 R4 

27 42 8 4 



A good question in present form which should succeed questions 
24, 20, 21 of old segment 34. 

T.O. 100 



Segment 33 #7 Rl R2 R3 , R4 

38 21 13 6 



A satisfactory question to test for the required T.O. 
T.O. 100 



Segment 33 #10 Rl R2 R3 R4 

24 24 25 6 



This, is an acceptable question for use in the new version of the 
study guide. 

T.O. 102 
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Segment 33 #11 



Rl R2 R3 RA 
32 29 13 2 



With some additions to the correct solution, for completeness makes 
this an acceptable problem to use in the new segment. 

T.O. 102 



Segment 33 #13 Rl R2 R3 R4 

29 33 10 1 



No changes were deemed necessary for the re-use of this question. 
T.O. 102 



Segment 33 #16 Rl R2 R3 R^ 

31 19 8 11 



Except for a slight modification to clarify the correct solution, 
this problem is otherwise unchanged for the new segment. 

T.O. 103 



Segment. 33 #17 Rl R2 R3 R^ 

31 23 14 1 



A poor question to test for the required T.O. It has been 
eliminated from the segment. 

T.O. 104 
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Segment 33 #19 



Rl R2 R3 R4 
27 20 8 9 



The only modifications of this problem were made in the included 
diagram. 

T.O. 105 



Segment 33 #20 Rl R2 R3 R4 

27 16, 16 7 



This problem will be re-employed in the new segment without changes, 
T.O. 105 



Segment 33 #22 Rl R2 R3 R4 

27 26 7 4 



This question properly tests for the required T.O.. and will be retained 
for use in the new segment. 

T.O. 105 



Segment 33 #23 Rl R2. R3 R4 

26 25 8 5 



This question will appear without change in the new study guide, 
T.O. 105' 
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Segment 33 #24 



Rl R2 R3 R4 
22 13 11 17 



With improvements made in the analysis of the solution, this 
problem will be re-used. Performance data is attributed primarily to 
other factors as indicated. 

T.O. 105 



Segment 34 #2 Rl R2 R3 R4 

18 18 11 4 



The statement of the question is poorly worded and, consequently, 
confusing to the students. This question .has been omitted. 

T.O. 106 



Segment 34 #3 Rl R2 R3 R4 

24 16 6 4 



An acceptable problem to test for the required T.O. without needing 
any modifications. 

T.O. 106 



Segment 34 #4 Rl R2 R3 R4 

14 11 13 11 



This question may be re-used without any modifications. Performance 
data is attributed primarily to other factors as indicated. 

T.O. 106 
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Segment 3A #5 



Rl R2 R3 R4 
23 12 11 4 



A valid item which does not require changes for use in the new 
segment. 

T.O. 106 



Segment 3A #6 Rl R2 R3 R4 

23 23 2 2 



An acceptable question in its present form. 
T.O. 100 



Segment 34 #8 Rl R2 R3 R4 

18 12 12 5 



This question properly supports the T.O. and may be used in the 
new segment. 

T.O. 106 



Segment 34 #9 Rl R2 R3 R4 

23 15 6 3 



This question is essentially a simple mechanics problem which does 
not support the T.O. and, therefore, has been eliminated. 

T.O. 106 
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Segment 34 #10 



Rl R2 R3 R4 
18 20 5 4 



Other questions better support the T.O. and have been chosen in 
preference to this one. 



T.O. 98 



Segment 34 #14 Rl R2 R3 R4 

15 15 4 3 



A valid question for testing the skills required by the T.O. 



Segment 34 #15 Rl R2 R3 R4 

11 11 10 4 



This question has been modified to eliminate areas that are 
potentially confusing. 

T.O. 100 



Segment 34 #22 Rl R2 R3 R4 

13 12 3 7 



Solution of this question requires merely substitution into the 
appropriate equation. This question does not sufficiently teach the 
principles of physics required for the T.O. and has been omitted from 
the new segment. 

T.O. 52 
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Segment 34 #23 



Rl R2 R3 R4 
11 12 6 6 



This question requires some modification to clarify its meanirtg. 
With the appropriate changes it becomes acceptable for use in the new 
segment. 

T.O. 100 



Segment 34 #24 Rl R2 R3 R4 

9. 6 11 9 



An acceptable question in its present form, and will be present in 

the new segment. Performance data is attributed primarily to other factor 
as indicated. 

T.O. 9 



Segment 35 #1 Rl R2 R3 R4 

14 13 5 1 



An acceptable question to test for skills required by the T.O. 
T.O. 101 



Segment 35 #2 Rl R2 R3 R4 

13 9 10 1 



No modifications are necessary to use this question in the new 
segment. Performance data is attributed primarily to other factors as 
indicated. 

T.O. 101 
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Segment 35 //3 Rl R2 R3 R4 

lA 7 7 4 



This question properly tests for knowledge necessary for an 
understanding of the appropriate T.O. and v;ill appear m the new 
segment. 

T.O. 101 



Segment 35 #6 Rl R2 R3 R4 

10 11 7 4 



The correct answer requires a correction to make this an acceptable 
problem for the new segment. 

T.O. 101 



Segment 35 //7 Rl R2 R3 R4 

7 12 6 6 



A valid item to test for the skills necessary for an understanding 
of the T.O. and will be used in the new version of the study guide. Per- 
formance data is attributed to other factors as indicated. 

T.O. 102 



Segment 35 //9 Rl R2 R3 R4 

10 11 5 1 



A Valid item to test for the skills necessary for an understanding 
of the T.O. and will be used in the new version of the study guide. 

T.O. 99 



ERIC 
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Segment 35 //lO 



Rl 
7 



R2 R3 R4 
5 10 3 



Inclusion of this question ■ redundant since 

T.O. has been thoroughly covered in a previous segment. 



the appropriate 



T.O. 106 



Segment 35 #11 



Rl 
11 



R2 R3 R4 
8 2 4 



Inclusion of this question would be redundant since the appropriate 
T.O. has been thoroughly covered in a previous segment. 

T.O. 21 

Segment 35 #12-24 - • 

Too few students worked this part of the segment to give meaningful 

data. 



A discussion about Ampere's Law in the information panel should 
help in understanding skills required by this question. 



Segment 36 //3 



Rl R2 R3 R4 
16 24 21 7 



T.O. 108 



ERIC 
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Segment 36 //6 



Rl R2 R3 R4 
23 11 6 26 



This question is confusing and cherefo has been omitted from the 
study guide. 

T.O. 108 



Segment 36 //8 Rl R2 R3 R4 

21 20 13 9 



A valid question which requires re-organization to be acceptable 
for the new segment. 

T.O. 109 



Segment 36 #11 Rl R2 R3 R4 

19 16 12 12 



This item is oat place in this segment and will be omitted 
from the new study gi rfm* , 

T.O. 99 . 



Segment 36 #12 Rl R2 R3 RA 

15 18 13 10 



In the arrangement of the new segment this problem has been 
placed in a better sequence. 

T.O. 102 
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Segment 36 #13 



Rl R2 R3 R4 
15 18 13 10 



ERIC 



A valid problem requiring only modification of the solution for 
use in the new study f e. 

T.O. 102 



Segment 36 #17 Rl R2 R3 R4 

19 27 2 1 



In the arrangement of the new segment this problem has been 
placed in a better sequence. 

T.O. 102 



Segment 36 #M Rl R2 R3 R4 

15 29 4 2 



This qiEstion has been eliminated from the study guide since it 
is confusingr^D- the students and other problems better support the T.O. 

T.O. 108 



Segment 36 ^SEL Rl R2 R3 R4 

12 19 0 18 



A valid .question which will be retained for the new study guide. 
Performance rfatra is attributed primarily to other factors as indicated, 

T.O. 110 
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Segment. 37 #1 



Rl R2 113 R4 
14 16 10 8 



In the new segment, other questions will precede this item in order 
to develop skills needed for its solution. 

T.O, 112 



Segment 37 //2 Rl R2 R3 R4 

15 16 8 9 



The correct solution requires some modifying to eliminate confusing 
areas and make this question acceptable for the new study guide. 

T.O. 112 



SegBEnt 37 *5 1 R2 R3 R4 

i4 14 7 8 



This question has been rewritten in a more explicit form for the 
new 3segment. 

T.O. 113 



SegnEsnt 37 #10 Rl R2 R3 R4 

16 17 6 1 



A good question, but out of place in this segment. This question 
belongs in the following segment. 

T.O.. 114 . ■ 

■ — -ft 
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Segment 3T -13S 



Rl R2 R3 R4 
8 19 7 3 



A gaoDa::^estlon, but out of place in this segment. This question 
belongs in: cSte following segment placed after question 10. 

T.O.. 114 



Segment ^E'^^ZZ Rl R2 R3 R4 

12 12 8 3 



A gBBEr^^Eastion, but ouit cf place in this segment- This question 
belongs Ti.v- i'VIw-l iollasadng segmCTt:, 

T.O. 116 



Segment^TS El R2 R3 R4 

13 IS 3 3 



A..-:ffl3SKaa»Bi«Kci oF^ire sign convention siumfllif be^itiduded ±n the 

Inf omatlniii r^a^ preceding this qxiestion to: ^wfapiately- prepare the 
students. 

T.O. 116 



Segment ' Rl R2 R3 R4 

.6 6 7 2 



Tlafe loC M vaiHid question to test for an understsnding of the 
T.O. an^iias mi^^xi mrrirtted from the segment. 

T.O. in 
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Segment 38 //2 



Rl R2 R3 R4 
9 7 2 2 



This is not a valid question to test for an understanding of the 
T.O. and has been omitted from the segment. 

T.O. Ill 



Segment 38 #3-24 Insufficient Data 



Too few students participated in these questions to give meaningful 

data. 



Segment 39 #6 Rl R2 R3 R4 

26 30 10 2 



This item will be placed in a more favor.^ib. "position in the 
new segment. 

T.O. 117 



Segment 39 #9 Rl R2 R3 R4 

33 21 6 7 



A valid question, from which superfluous 3Eff:ormation has been 
eliminated, for use in the new version study gu^e. 

T.O. 117 
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Segment 39 #10 



Rl R2 R3 R4 
32 20 11 3 



No changes are necessary to use this question in the new segment, 
T.O. 118 



Segment 39 /fl2 Rl R2 R3 R4 

17 20 8 9 



This quesi±Dn has been rewrStjten to remove amb±guities contained 
in the original -version. 

T.O. 158 



Segment 39 #16 Rl R2 R3 R4 

29 30 11 5 



This is an --acceptaible question, in its present .form, tD test for 
skills required for the T.O. 

T.O. 120 



Segment 39 #20 Rl R2 R3 R4 

28 18 12 4 



This question has been removed .sfrnce its inclusion' would be 
redi'UBilant. 



T.O... J.20 
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Segment 39 #21 



Rl R2 R3 R4 
20 13 18 11 



An information panel discussing the Tnagnetlc 'r' ' . rgy density 
will precede this question in the new study guide. 

T.O. 120 



Segment 40 #3 Rl R2 R3 R4 

19 15 15 8 



TSsLs question is too trivial for inclusion at this stage of the 
course. 

T.O. 121 



Segment 40 #3 Rl R2 R3 R4 

25 20 8 4 



This question is too trivial for inclusion at this stage of the 
coarse. 



T.ja. 121 



Segment 40 #13 Rl R2 R3 R4 

17 14 12 10 



ModificstLoas have bfeeas nm^rfe to clarify the meaning of this 
question. 

T.O- 122 
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Segment 40 #14 



SI R2 R3 R4 
^1 19 7 6 



The correct solution has been rewritten and this question has been 
placed in a more appropriate position in the jaew study guide. 

T.O. 121 



Segment 40 //15 Rl R2 R3 r4 

21 13 9 9 



A. valid question which will be of most benefit in tike enrichmeTit 
segment. 

T.O. 121 



Segment 40 #16 . Bl R2 R3 R4 

21 21 8 1 



An acceptable question in its present form for the new segment. 
T.O. 123 



Segment 40 #22 Rl R2 il3 R4 

18 23 2 4 



An acceptal)le question wM.ch will be placed in m moiSB; favorable 
•position in the new study guide- 

T.O. 121 
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VIII OBJECTIVES INDEX AND DATA COMPILATION 




A tabulation of the TcajTai: data used 
in revision (listed by ci^estive) . 



ERIC 
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OBJECTIVES INDEX Am DATA COMPILATION 



Explanation of 

PRETEST " Item 

C(U/L) 

POSTTEST — Item 

L,C, 

C(U/L) 

FINAL ~ Item 

M/F 
C(U/L) 

STUDY GUIDE — Item 

One Punch 

Two, Three, 
and Four Punch 

E,0, 

(AV) 
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Column Headings 



Problem identified by volume 
letter and number 

Average percentage correct 

(In this columa U/L does not apply) 

Problem identified by volume 
letter and number 

Learning Category 

Average perceu^:age correct 
(upper half /lower half) 

Problem number 

Multiple choice/Fill-in 

Average percentage correct 
(upper half /lower half) 

ProbliBm identified by volume 
letter, grouping, and number 

Number of students selecting one 
answer to the item 

Number of students selecting two, 
three, or four answers to the item 

Enabling objective for item 

The notation ''(AV)'* in the Terminal 
Objective column indicates that 
audio-visuals are associated with 
that objective 
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